Comet ML

Comet ML

Stand-alone tool.

Available as a free community product, self-service commercial software, and managed enterprise product.

Any cloud environment.
On-premise.

Seat-based licenses.

Comet Enterprise: there are service level guarantees that depend on your plan.

Comet Enterprise: there are service level guarantees that depend on your plan.

Community: None.
Comet Enterprise: advanced user management options.

Community: None.
Comet Enterprise: advanced user management options.

Community: install Comet's SDK and add two lines of code to your jobs.
Comet Enterprise: In addition to the above, a full system deployment is typically required (it is possible to purchase Enterprise licenses for the cloud product as well).

Comet's metadata structure is static. UI built to scale to tens of thousands of experiments and models. Full APIs to access all parts of the platform (Python and REST).

Supports:
Model versioning
Data lineage

Comet also supports full lineage by tracking the data, code and paramaters used during a training run as well as any data or model generated by that training run.

Comet has an experiment tracking solution that tracks out of the box:
Source code
Parameters and metrics
Artifacts consumed or generated from the training run

It is possible to manually log complex data types to adapt to any workflow. The most commonly logged data includes:
Text
Images
Video
Geo-spacial data

Models and Experiments can be compared through:
Table interface: Allows for quick comparison of parameters and metrics.
Panel interface: Allows for in depth comparison of parameters and metrics.

The panel interface supports over 100 visualization types including line charts, bar charts, parallel coordinates charts, and image viewers. Custom panels can be created and shared for any visualizations that are not currently supported.

Experiments and models belong to a project and each project belongs to a workspace.

Comet supports:
Searching by tag
Filtering experiments in the UI based on any parameter and value
Fully customizable table

Support for moving models between different stages including staging and production but also any other custom stage.
Artifacts are immutable and ensure full reproducibility of deployed models.

The Model Registry can be integrated with any CI/CD system.

Comet integrates with many third-party libraries and tools, you can refer to the Comet documentation and blog for a full list of supported integrations.