Skip to main content

106 posts tagged with "MLOps"

MLOps, Practices and Tools for Tracking, Versioning, Deploying and Monitoring Machine Learning Models

View All Tags

MLflow Tutorial for Machine Learning in Python — Part 2: Log Metrics Over Time and System Metrics

· 38 min read
Jagdish Kumawat
Founder @ Dewiride

Part 1 logged each score once, after training was over. That hides the question every model raises: was more training still helping? In this part the forest grows in stages, MLflow records its score after every stage, and the curves show where extra trees stop paying off. MLflow also records how hard the computer worked while it trained.

How to Change the X-Axis of a Metric Chart in the MLflow UI

· 11 min read
Jagdish Kumawat
Founder @ Dewiride

When a run logs a metric at several steps, the MLflow UI draws it as a line against Step. That's one of four choices: the same chart can run along the clock, along the seconds since the run's first value, or along another metric. This guide tries all four on one chart, then changes every chart at once, with screenshots from MLflow 3.18.0.

How to Change the System Metrics Sampling Interval in MLflow

· 8 min read
Jagdish Kumawat
Founder @ Dewiride

By default, MLflow samples the computer's CPU, memory, disk and network every 10 seconds. That suits a training job that runs for an hour, but a run that lasts a minute gets about five points, and a run shorter than 10 seconds gets none. Two functions change how often MLflow samples and how many samples it averages into each point. This guide tries three settings on the same run, with real output from MLflow 3.18.0.

How to Turn On System Metrics Logging in MLflow

· 8 min read
Jagdish Kumawat
Founder @ Dewiride

MLflow can record what the computer is doing while a run works: CPU use, memory, disk and network. On a long training job, that shows whether the model is starved for memory or using every core. It's off by default and needs one extra package. This guide turns it on three ways and reads the results, with real output from MLflow 3.18.0.

How to Get the History of a Metric in MLflow

· 6 min read
Jagdish Kumawat
Founder @ Dewiride

When a run logs a metric many times, such as a loss after every round of training, MLflow keeps every value. The run's summary shows only the latest one, though. MlflowClient.get_metric_history returns them all, each with its step and the moment it was logged. This guide reads a short curve back and finds its best step, with real output from MLflow 3.18.0.

Fixed: "No charts in this section" on the MLflow System Metrics Tab

· 12 min read
Jagdish Kumawat
Founder @ Dewiride

The System metrics tab of a short MLflow run said System metrics (0) and "No charts in this section", although system metrics were turned on and longer runs had their charts. MLflow logs a sample only after waiting one sampling interval and finding the run still going, so a run that ends sooner records nothing. Sample more often than your shortest run lasts.

MLflow Tutorial for Machine Learning in Python — Part 1: Install MLflow and Track Your First Experiment

· 42 min read
Jagdish Kumawat
Founder @ Dewiride

Every time you train a model, you change something: the number of trees, a setting, the data. A week later nobody remembers which change gave the best result. MLflow remembers it for you. In this first part you install MLflow, start your own tracking server, and log your first machine learning experiment from Python.

How to See Where MLflow Stores Runs and Artifacts

· 11 min read
Jagdish Kumawat
Founder @ Dewiride

An MLflow tracking server keeps your work in two places: a database for experiments, runs, parameters, metrics and tags, and a folder for the files your runs log, such as charts and models. With the default settings, both sit in the folder you started the server from. This guide finds them, follows one run from the UI to its files and database rows, and reads the database safely, with real output from MLflow 3.18.0.

How to Compare Runs in the MLflow UI

· 13 min read
Jagdish Kumawat
Founder @ Dewiride

Tracking runs pays off when you compare them: which settings gave the lowest error, and was the extra training time worth it? The MLflow UI gives you a runs table you can filter and sort, a chart view, and a Compare page with four plots and side-by-side tables. This guide uses all of them on four real runs, with screenshots from MLflow 3.18.0.

How to Add Tags to an MLflow Run

· 5 min read
Jagdish Kumawat
Founder @ Dewiride

Tags are labels on a run: the model type, the dataset, who owns it. Unlike parameters, you can change them later, and unlike metrics, they're text. MLflow also adds its own tags to every run, such as who ran it and which Git commit the code was at. This guide sets tags, overwrites one, adds a run description, and lists everything MLflow recorded, with real output from MLflow 3.18.0.