Skip to content

Add support Intel Arc A770 #27

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
savvadesogle opened this issue Mar 24, 2025 · 2 comments
Closed

Add support Intel Arc A770 #27

savvadesogle opened this issue Mar 24, 2025 · 2 comments

Comments

@savvadesogle
Copy link

savvadesogle commented Mar 24, 2025 •
edited
Loading

Hello.
How to start model on Intel Arc A770 (4xGPU with 64 VRAM)?

Thank you
@lingtengqiu
Copy link
Collaborator

lingtengqiu commented Mar 25, 2025 •
edited
Loading

Our model requires the GPU device. :(. see #29

@savvadesogle
Copy link
Author

savvadesogle commented Mar 25, 2025 •
edited
Loading

Our model requires the GPU device. :(. see #29

I have 128GB RAM and 64GB video RAM on 4x A770 GPU (GDDR6).
Single gpu has 16GB. 4 GPU has 64 GB memory.

Device type is XPU: https://pytorch.org/tutorials/recipes/intel_extension_for_pytorch.html#id6
Its support dtypes torch.float32 and torch.bfloat16

'cuda' -> 'xpu'

LHM/app.py

Line 519 in 152917a

device = "cuda"

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
3 participants
@savvadesogle @lingtengqiu @hitsz-zuoqi