DEV Community

Cover image for Machine learning possible with small data?
Danial Ranjha for Traindex

Posted on • Edited on • Originally published at traindex.io

Machine learning possible with small data?

It's not worth trying machine learning projects unless you have a huge data set.

True or false?

Smaller companies are afraid to add machine learning features to their projects unless they have big data. They think that since they're not Amazon or Microsoft, they don't have a large enough data set to be successful in taking on machine learning projects or features.

There are definitely applications of machine learning that can work even on small data sets. Perhaps you can start small and prove out a concept, before investing in getting more data to build a larger model. You can also use off-the-shelf models in AWS, Azure, and GCP to solve generic problems.

With smaller data sets you will encounter problems that you need to be weary of, such as over fitting, bias, and data imbalance. With the right tools and people, there are strategies to overcome these problems.

Like any good project management program, you can invest in small wins to either prove out the concept. This can help you gain credibility in a new program, and then getting funding for bigger and bolder bets.

Top comments (1)

Collapse
 
jwodjhd_hshsj_04a17c5dbb8 profile image
Jwodjhd Hshsj

Hyper Tough has expanded its range of battery-operated, cordless tools that reduce reliance on gasoline or corded electricity. These battery-powered tools produce fewer emissions compared to gas-powered equipment and provide users with the flexibility to work in spaces without access to electrical outlets this website. With longer-lasting batteries and energy-efficient designs, these tools offer an environmentally friendly option for users who are conscious about reducing their carbon footprint while still achieving professional-quality results.