From: Jie Fu (傅杰) <redacted>
Date: Wed, 24 Sep 2025 06:46:52 +0000 (+0800)
Subject: model-conversion : run-org-model.py fails to run on mac m1 (#16213)
X-Git-Tag: upstream/0.0.6641~78
X-Git-Url: https://git.djapps.eu/?a=commitdiff_plain;h=7735706b939847df2c6c00b44c36f95a20137c61;p=pkg%2Fggml%2Fsources%2Fllama.cpp

model-conversion : run-org-model.py fails to run on mac m1 (#16213)

Signed-off-by: Jie Fu <redacted>
---

diff --git a/examples/model-conversion/scripts/causal/run-org-model.py b/examples/model-conversion/scripts/causal/run-org-model.py
index 78a54abf..9444c713 100755
--- a/examples/model-conversion/scripts/causal/run-org-model.py
+++ b/examples/model-conversion/scripts/causal/run-org-model.py
@@ -193,7 +193,7 @@ print(f"Input text: {repr(prompt)}")
 print(f"Tokenized: {tokenizer.convert_ids_to_tokens(input_ids[0])}")
 
 with torch.no_grad():
-    outputs = model(input_ids)
+    outputs = model(input_ids.to(model.device))
     logits = outputs.logits
 
     # Extract logits for the last token (next token prediction)