Value scoping, discovery, delivery, and stewardship
In Part 1 of this series we examined the key differences between software and models; in Part 2 we explored the twelve traps of conflating models with software; and in Part 3 we looked at the evolution of models. In this article, we go through the model lifecycle, from the initial conception of the idea to build models to finally delivering the value from these models. Read More
Tag Archives: DevOps
10 MLops platforms to manage the machine learning lifecycle
Machine learning lifecycle management systems rank and track your experiments over time, and sometimes integrate with deployment and monitoring
For most professional software developers, using application lifecycle management (ALM) is a given. Data scientists, many of whom do not have a software development background, often have not used lifecycle management for their machine learning models. That’s a problem that’s much easier to fix now than it was a few years ago, thanks to the advent of “MLops” environments and frameworks that support machine learning lifecycle management. Read More
Consequences of mistaking models for software
Twelve traps to avoid when building and deploying models
In Part 1 of this series on data scientists are from Mars and software engineers are from Venus we examined the five key dimensions of difference between software and models. The natural follow on question to ask is — So What? Does it really matter if models are conflated with software and data scientists are treated as software engineers? After all for a large cross-section of the population, and more importantly the business world, the similarities between them are far more visible than their differences. In fact, Andrej Karpathy refers to this new way of solving problems using models as Software 2.0. If they are really the next iteration of software are these differences really consequential. Read More
Data Scientists are from Mars and Software Developers are from Venus (Part 1)
Mars and Venus are very different planets. Mars’s atmosphere is very thin and it can get very cold; while Venus’s atmosphere is very thick and it can get very hot — hot enough to melt lead!.
…Software Engineers and Data Scientists come from two different worlds — one from Venus and the other from Mars. They have different backgrounds mindsets, and deal with different sets of issues. They have a number of things in common too. In this and subsequent blogs we will look at the key differences (and similarities) between them and why those differences exist and what kind of bridge we need to create between them. In this blog, we explore the fundamental differences between software and models. Read More
Responsible AI Can Effectively Deploy Human-Centered Machine Learning Models
Artificial intelligence (AI) is developing quickly as an unbelievably amazing innovation with apparently limitless application. It has shown its capacity to automate routine tasks, for example, our everyday drive, while likewise augmenting human capacity with new insight. Consolidating human imagination and creativity with the adaptability of machine learning is propelling our insight base and comprehension at a remarkable pace.
However, with extraordinary power comes great responsibility. In particular, AI raises worries on numerous fronts because of its possibly disruptive effect. These apprehensions incorporate workforce uprooting, loss of protection, potential biases in decision-making and lack of control over automated systems and robots. While these issues are noteworthy, they are likewise addressable with the correct planning, oversight, and governance. Read More
Low-code platforms and the democratization of AI
Tech giants like IBM and Amazon are developing products that will make it easier for people without a coding background to build apps that integrate with AI services.
Key Takeaway: Low-code and no-code platforms are seeing new life, as access to artificial intelligence and fast deployment of applications becomes increasingly critical with the popularity of Cloud-based software development. These products enable those without a coding background to more easily access the benefits of AI. Read More
Low-Code Can Lower the Barrier to Entry for AI
Organizations that want to get started quickly with machine learning may be interested in investigating emerging low-code options for AI. While low-code techniques will never completely replace hand-coded systems, they can help accelerate smaller, less experienced data science teams, as well as help with prototyping for professional data scientists.
First of all, what is low-code? Well, the phrase can mean different things to different people, and its applicability to AI is not entirely nailed down. Mainstream developers have been using low-code (or no-code) approaches to creating business and consumer applications for years, and that largely forms the basis for low-code approaches in AI. Read More
A Tour of End-to-End Machine Learning Platforms
Machine Learning (ML) is known as the high-interest credit card of technical debt. It is relatively easy to get started with a model that is good enough for a particular business problem, but to make that model work in a production environment that scales and can deal with messy, changing data semantics and relationships, and evolving schemas in an automated and reliable fashion, that is another matter altogether. If you’re interested in learning more about a few well-known ML platforms, you’ve come to the right place! Read More
Why Best-of-Breed is a Better Choice than All-in-One Platforms for Data Science
All-in-one platforms built from open source software make it easy to perform certain workflows, but make it hard to explore and grow beyond those boundaries.
So you need to redesign your company’s data infrastructure.
Do you buy a solution from a big integration company like IBM, Cloudera, or Amazon? Do you engage many small startups, each focused on one part of the problem? A little of both? We see trends shifting towards focused best-of-breed platforms. That is, products that are laser-focused on one aspect of the data science and machine learning workflows, in contrast to all-in-one platforms that attempt to solve the entire space of data workflows.
This article, which examines this shift in more depth, is an opinionated result of countless conversations with data scientists about their needs in modern data science workflows. Read More
Jira is a microcosm of what’s broken in software development
This blog is not about how Jira is too complex and over-engineered with features I don’t need.
Those complaints are well articulated by others.
… Over the years I have arrived at the conclusion that Jira contradicts my values as a member of a dev team. It represents a way of thinking and working that goes against my beliefs. Read More
Rick's Cafe AI 