DEV Community

Cover image for Memory efficient parsing in GO
MoniqueLive
MoniqueLive

Posted on

Memory efficient parsing in GO

#go #json #xml #stream

Instead of greedily reading the whole stream in memory and passing it to json.Unmarshal:

json.Unmarshal(bigBlobOfData, &myStruct)
Enter fullscreen mode Exit fullscreen mode

We can delegate the stream reading to our dear masters of golang:

json.NewDecoder(myIOReader).Decode(&myStruct)
Enter fullscreen mode Exit fullscreen mode

And read multi giga(tera?)bytes files with no sweat. Also works with xml.NewDecoder.

Top comments (0)

Read next

embiem profile image

How to Consistently Retrieve Valid JSON from Claude 3.5 in Go

Martin Beierling-Mutz -

brunociccarino profile image

Best Practices for Building Fintech Apps in Go 🚀💰

Bruno Ciccarino λ -

githaiga22 profile image

🚀 Go-ing Full-Stack: Building Dynamic Web Apps with Go 🐹, PostgreSQL 🐘, Docker 🐳, and HTTP Servers 🌐

Allan Githaiga -

sha254 profile image

Testing REST APIs in Go: A Guide to Unit and Integration Testing with Go's Standard Testing Library

sean -