Dagster
keyboard_arrow_down 11 guides
1. Dagster
Getting started with DagsterLogging asset metadataAdding compute kind badgeslockGrouping assetslockIO ManagerslockDAGSTER_HOME and dagster.yamllockCode locationslockDifferent ways to materialize assetslockAccessing execution context within assetslockSetting run-time configurationslockDagster jobslock
check_circle
Mark as learned thumb_up
0
thumb_down
0
chat_bubble_outline
0
Comment auto_stories Bi-column layout
settings
Adding Compute Kind Badges in Dagster
schedule Aug 12, 2023
Last updated local_offer
Tags Dagster
tocTable of Contents
expand_more Master the mathematics behind data science with 100+ top-tier guides
Start your free 7-days trial now!
Start your free 7-days trial now!
Adding a computation badge
To indicate what framework/library (e.g. pandas, spark) we use for creating the asset, we can specify the compute_kind property like so:
from dagster import assetimport pandas as pd
@asset(name="iris_data", compute_kind="pandas")def get_iris_data(): return df
@asset(name="setosa", compute_kind="pandas")def get_setosa(iris_data):
In the Dagster UI, we should now see the following:
Other common compute_kind is python, spark, sql, matplotlib, numpy and dbt. For instance, let's see how the python and spark compute badges look like:
Custom computation badge
We can also add our own compute_kind - the downside is that we don't get a nice icon:
For now, we are not able to create our own icons in Dagster 😞.
Published by Isshin Inada
Edited by 0 others
Did you find this page useful?
thumb_up
thumb_down
Comment
Citation
Ask a question or leave a feedback...
thumb_up
0
thumb_down
0
chat_bubble_outline
0
settings
Enjoy our search
Hit / to insta-search docs and recipes!
