ML Projects Aren't An Island | Tecton

Tecton

ML Projects Aren’t An Island

apply(meetup) - Feb '22 - 10 minutes

We've all seen the dismal and (at this point, annoying) charts and graphs of '>90.x% of ML projects fail' used as marketing ploys by various companies. What this largely simplified view of ML project success rates buries in misleading abstraction is the fact that some companies have a 100% success rate with long-running ML projects while others have a 0% success rate. This talk is intending to go through a simple concept that is obvious to the 100% success rate companies but is a mystery to those that fail time and again. Firstly, that a project is not an island. It has dependencies on other teams (both technical and non-technical), that the DS team doesn't need to be heroic in pursuing the most complex solution, and how establishing solid engineering practices is what will set apart the projects that will succeed and those that will fail. The main points that will be covered:
  • Can you really solve this with ML? Should you?
  • Make sure you have the data consistently and that's it's not garbage (feature stores are great!)
  • Start simple and only add complexity if you need to
  • Involve the business (SMEs)
  • Build code that your team can maintain and test
  • Monitor your data and predictions so you know when things are about to break
Ben Wilson

Principal Resident Solutions Architect

Databricks

Ben Wilson spent 10 years keeping lights illuminated on ships in the US Navy, did a stint as a tugboat driver, worked as a Process Engineer in various manufacturing and semiconductor companies, and has spent the last 12 years working as a Data Scientist / ML Engineer for a handful of companies. The last 4 years he's been at Databricks, working with customers to scale and implement both ETL and ML use cases. He's the author of the Manning book "Machine Learning Engineering in Action" and is currently working on the MLflow team at Databricks where he gets to see some truly brilliant software engineers build really cool stuff.

Let's keep in touch

Receive the latest content from Tecton!

© Tecton, Inc. All rights reserved. Various trademarks held by their respective owners.

The Gartner Cool Vendor badge is a trademark and service mark of Gartner, Inc., and/or its affiliates, and is used herein with permission. All rights reserved.
Gartner does not endorse any vendor, product or service depicted in its research publications, and does not advise technology users to select only those vendors with the highest ratings or other designation. Gartner research publications consist of the opinions of Gartner’s research organization and should not be construed as statements of fact. Gartner disclaims all warranties, expressed or implied, with respect to this research, including any warranties of merchantability or fitness for a particular purpose.

Request a Demo

Request a free trial

Interested in trying Tecton? Leave us your information below and we’ll be in touch.​

Contact Sales

Interested in trying Tecton? Leave us your information below and we’ll be in touch.​