Skip to content
Navigation menu
Search
Search
Log in
Create account
DEV Community
Close
#
inference
Follow
Hide
Posts
Left menu
đź‘‹
Sign in
for the ability to sort posts by
relevant
,
latest
, or
top
.
Right menu
In the Fast Lane! Speculative Decoding - 10x Larger Model, No Extra Cost
Rockayyy
Rockayyy
Rockayyy
Follow
for
TitanML
Oct 5 '23
In the Fast Lane! Speculative Decoding - 10x Larger Model, No Extra Cost
#
titanml
#
awq
#
decoding
#
inference
3
 reactions
Comments
Add Comment
6 min read
From first click to prompt output in 1m38s - Running Llama2 in Codesphere
Simon Pfeiffer
Simon Pfeiffer
Simon Pfeiffer
Follow
for
Codesphere Inc.
Aug 18 '23
From first click to prompt output in 1m38s - Running Llama2 in Codesphere
#
llama
#
largelanguagemodels
#
inference
#
codesphere
6
 reactions
Comments
Add Comment
5 min read
Object detection Part 6 - Inference in java [Tensorflow]
Daniel Persson
Daniel Persson
Daniel Persson
Follow
Nov 12 '18
Object detection Part 6 - Inference in java [Tensorflow]
#
objectdetection
#
tensorflow
#
java
#
inference
6
 reactions
Comments
Add Comment
1 min read
loading...
We're a place where coders share, stay up-to-date and grow their careers.
Log in
Create account