Search results

Illegal Instruction on CPU build

Status: Open.

#53 In inferflow/inferflow;

· clifflynt opened on Dec 11, 2024

How to make Q8 inference faster?

Status: Open.

#52 In inferflow/inferflow;

· immocreat opened on Jun 7, 2024

what does return_output_tensors parameter do in inferflow_service.ini

Status: Open.

#51 In inferflow/inferflow;

· ShadowTeamCN opened on Jun 6, 2024

Do you have quantitative comparisons on inference metrics with other popular inference engines?

Status: Open.

#50 In inferflow/inferflow;

· immocreat opened on Jun 2, 2024

Does opt_13b model support tensor parallelism vias inferflow?

Status: Open.

#49 In inferflow/inferflow;

· LHQUer opened on Mar 18, 2024

Support of Whisper

Status: Open.

#41 In inferflow/inferflow;

· nemoramo opened on Feb 23, 2024

Can give a example on huggingface model such as Phi-2,Yi etc.

Status: Open.

#21 In inferflow/inferflow;

· Arcmoon-Hu opened on Jan 18, 2024

Does it support Apple Silicon (M1/M2/M3)?

Status: Open.

#18 In inferflow/inferflow;

· zoopigzoo opened on Jan 17, 2024