DEV Community

Victory Ezenwa
Victory Ezenwa

Posted on

READING RECENT DOCUMENTATION CAN SAVE YOU A LOT OF TIME: MY EXPERIENCE TRYING TO UPSERT VECTORS TO MY PINECONE DATABASE

My name is Ezenwa Victory Chibuikem, a recent graduate of Electrical and Electronics Engineering from FUTO. I am a data scientist looking to extend my expertise to machine learning engineering. I view machine learning engineering as a role designed for software engineers who can build machine learning models. Recently, I signed up for and was accepted into HNG Internship 11, where I joined the Backend track to gain experience as a software engineer, particularly in Backend development. If you are seeking valuable experience in fields like mobile development, DevOps, backend, frontend, or data analysis, HNG is an excellent starting point. You can explore more at HNG internship (https://hng.tech/internship) or HNG hire(https://hng.tech/hire).

Today, I will be writing about my most recent backend roadblock. Although I wouldn’t call it a difficult backend problem, it was certainly one I couldn’t have solved on my own. I was building an e-commerce product recommendation system that used inputted texts and images to recommend products to users. This was done using Flask, and Pinecone served as my vectorized database. After setting up a connection, I couldn’t seem to upsert any records. The error message displayed wasn’t helpful either, as it didn’t point to a failed insertion but rather to incorrect dimensions of my vectors.

At first, I thought the issue was with my vectorization. I even changed the vectorization scheme twice (hard lesson: check your function arguments before changing your entire logic). After hours of debugging and searching, I was able to narrow it down to the upsert line of code and began rechecking it with examples on the internet. I found someone with a similar problem on Stack Overflow, and my issue was solved. The error resulted from assigning a value to a deprecated argument. Initially, I was angry at the energy spent trying to overcome this, but in the end, I couldn’t be happier that I got to move on to other parts of the project.

I hope this was an insightful read. I’m looking forward to seeing how much my software engineering skills will improve after this internship. Till next time!

Top comments (0)