Skip to content

Commit 947307f

Browse files
authored
[Fix] fix lint in lmdeploy_mistral - #2571 (#2571)
1 parent 8d474f8 commit 947307f

4 files changed

Lines changed: 16 additions & 4 deletions

configs/models/mistral/lmdeploy_mistral_large_instruct_2407.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,10 @@
1111
tp=4,
1212
cache_max_entry_count=0.7,
1313
),
14-
gen_config=dict(top_k=1, temperature=1e-6, top_p=0.9, max_new_tokens=4096),
14+
gen_config=dict(top_k=1,
15+
temperature=1e-6,
16+
top_p=0.9,
17+
max_new_tokens=4096),
1518
max_seq_len=32768,
1619
max_out_len=4096,
1720
batch_size=8,

configs/models/mistral/lmdeploy_mistral_large_instruct_2411.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -11,7 +11,10 @@
1111
tp=4,
1212
cache_max_entry_count=0.7,
1313
),
14-
gen_config=dict(top_k=1, temperature=1e-6, top_p=0.9, max_new_tokens=4096),
14+
gen_config=dict(top_k=1,
15+
temperature=1e-6,
16+
top_p=0.9,
17+
max_new_tokens=4096),
1518
max_seq_len=32768,
1619
max_out_len=4096,
1720
batch_size=8,

configs/models/mistral/lmdeploy_mistral_nemo_instruct_2407.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,10 @@
66
abbr='mistral-nemo-instruct-2407-turbomind',
77
path='mistralai/Mistral-Nemo-Instruct-2407',
88
engine_config=dict(session_len=32768, max_batch_size=16, tp=1),
9-
gen_config=dict(top_k=1, temperature=1e-6, top_p=0.9, max_new_tokens=4096),
9+
gen_config=dict(top_k=1,
10+
temperature=1e-6,
11+
top_p=0.9,
12+
max_new_tokens=4096),
1013
max_seq_len=32768,
1114
max_out_len=4096,
1215
batch_size=16,

configs/models/mistral/lmdeploy_mistral_small_instruct_2409.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -6,7 +6,10 @@
66
abbr='mistral-small-instruct-2409-turbomind',
77
path='mistralai/Mistral-Small-Instruct-2409',
88
engine_config=dict(session_len=32768, max_batch_size=16, tp=2),
9-
gen_config=dict(top_k=1, temperature=1e-6, top_p=0.9, max_new_tokens=4096),
9+
gen_config=dict(top_k=1,
10+
temperature=1e-6,
11+
top_p=0.9,
12+
max_new_tokens=4096),
1013
max_seq_len=32768,
1114
max_out_len=4096,
1215
batch_size=16,

0 commit comments

Comments
 (0)