Skip to content

DEV Community

# inference

👋 Sign in for the ability to sort posts by relevant, latest, or top.

Rockayyy for TitanML

Oct 5 '23

In the Fast Lane! Speculative Decoding - 10x Larger Model, No Extra Cost

#titanml #awq #decoding #inference

6 min read

Simon Pfeiffer for Codesphere Inc.

Aug 18 '23

From first click to prompt output in 1m38s - Running Llama2 in Codesphere

#llama #largelanguagemodels #inference #codesphere

5 min read

Nov 12 '18

Object detection Part 6 - Inference in java [Tensorflow]

#objectdetection #tensorflow #java #inference

1 min read

loading...