Skip to content

Model on single GPU ?  #32

Open
Open
Model on single GPU ? #32
@PiPyL

Description

@PiPyL
PiPyL
opened on Feb 20, 2024

hello,

Is there a way to load and serve multiple models on a single GPU
my computer:
gpu: RTX 3060
cpu: i7-12700
ram: 16gb

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Fields

    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions