Skip to content

No GPUs on inf2 instances #753

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
btlorch opened this issue Sep 17, 2024 · 1 comment
Open

No GPUs on inf2 instances #753

btlorch opened this issue Sep 17, 2024 · 1 comment
Assignees
Labels
Data request Data provided by AWS that should be included.

Comments

@btlorch
Copy link

btlorch commented Sep 17, 2024

Thank you for making available this great overview.

I launched an inf2.8xlarge instance because the table [1] suggests that it comes with a 32 GB GPU. However, the instance does not seem to have a GPU.

May I ask where the information about the GPU support of inf2 instances is based on?

[1] https://instances.vantage.sh/?selected=inf2.xlarge,inf2.8xlarge,inf2.24xlarge,inf2.48xlarge

@Bensign Bensign self-assigned this Mar 21, 2025
@Bensign Bensign added the Data request Data provided by AWS that should be included. label Mar 21, 2025
@Bensign
Copy link
Contributor

Bensign commented Mar 21, 2025

@btlorch Hey sorry for the incredibly slow response time here. I'm trying to spend a bit more of my spare time here on the project....it looks like this was git-blamed back to @EverettBerry - unless he has some rationale for this, I may just revert this back.

Some quick googling shows that inf instances have inferentia chips from AWS which are specialized for inference but don't actually have GPUs.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Data request Data provided by AWS that should be included.
Projects
None yet
Development

No branches or pull requests

2 participants