Support for OpenTelemetry traces and span/trace ids in log lines

What's the use case?

Dagster's executions result in nice trace-like structure well visualized in your GUI, those same traces would be useful in other ways were they to be published as OpenTelemetry tracing events. To connect all the dots when this is enabled all log lines should include trace and span-id so they can be correlated to the traces. Many companies are adopting OpenTracing to debug issues, we at Klar require this for all services. This is a gap in the "observability triangle" for Dagster that could easily be plugged.

Ideas of implementation

Possibly useful https://gist.github.com/gburd/01d0d4214ab4e4fb82c7fe0179f4f60b and Implement a default telemetry provider parallel to the default logger · Issue #11191 · dagster-io/dagster

Additional information

No response

Message from the maintainers

Impacted by this issue? Give it a ! We factor engagement into prioritization.