Incorrect `Interest::Never` is cached and never invalidated on v0.1
Bug Report
Version
tracing-core 0.1.32. The master branch does not have the relevant optimization and is probably fine.
Platform
x86_64 Linux
Crates
tracing-core
Description
Under the right set of circumstances, it is possible for all events and spans to be silenced, regardless of the subscriber's configuration.
The particular sequence of events is as follows:
- A
Dispatchobject is created, wrapping any kind of subscriber (an fmt subscriber with maximum logging will do). The object must not be set as the global or thread-local dispatcher yet. - A tracing macro is called. Since no dispatcher is configured yet, nothing is printed, as expected.
- The dispatch object from step 1 is registered as a thread-local dispatcher, using
tracing::dispatcher::with_default - The same line of code as step 2 is executed again. One would expect this to print, since a dispatcher is now configured, but instead nothing happens again.
The following piece of code demontrates the bug is a deterministic way. You can achieve a similar result using only the higher level tracing::subscriber::with_default API, but that requires multiple threads and a bit of luck to get the right order of operations.
fn is_enabled() -> bool {
tracing::info!("log me maybe");
return tracing::enabled!(tracing::Level::DEBUG);
}
fn main() {
let subscriber = tracing_subscriber::fmt()
.with_max_level(tracing::Level::TRACE)
.finish();
let dispatch = tracing::Dispatch::new(subscriber);
// This returns false and doesn't print anything, as expected
is_enabled();
tracing::dispatcher::with_default(&dispatch, || {
// This should have returned true, but does not.
assert!(is_enabled());
});
}I've tracked the bug down to an optimization in tracing-core's callsite module, specifically the has_just_one atomic boolean.
- At step 1, a dispatcher is created and registered using the
Dispatchers::register_dispatchmethod. Since it is the first one to be registered, thehas_just_oneflag is set to true. - At step 2, the call site of the tracing macro needs to be registered, using
DefaultCallsite::register. In that process, the callsite's interest is calculated byrebuild_callsite_interest.DefaultCallsite::registerhad created and passed in aRebuilderobject, and based on the value ofhas_just_one, aRebuilder::JustOneis used. - The
rebuild_callsite_interestfunction callsRebuilder::for_eachto iterate over all the registered dispatchers. Since the rebuilder is aJustOne, thefor_eachfunction usesdispatcher::get_defaultas an optimization which should point to the one and only dispatcher in existence. - However, because the only registered dispatcher is not active yet,
dispatcher::get_defaultactually returns theGLOBAL_DISPATCHobject, which points to a no-op subscriber. - The no-op subscriber returns a
Neverinterest. This interest is cached by thecallsitemodule. - At step 3, the original dispatcher is made active. Since it had already been created and registered in step 1, the interest cache is not invalidated.
- Finally at step 4, the cached
Neverinterest is used again when the same macro call is made, even though that is now incorrect. No log line is printed.
The core of the issue comes from the has_just_one optimization, which is in contradiction with the fact that there are in fact two dispatchers: the global no-op one and the registered but not yet active one. One fix would be to register the global no-op to make the has_just_one flag more accurate. However I believe that by doing this, has_just_one would pretty much never be true. I think an easier solution would be to remove that optimization altogether. Indeed, it doesn't even exist on the master branch anymore.
If there had been other dispatchers around, has_just_one would have been false and the fallback code path would have worked fine. This can be tested by adding let _dont_drop_me = tracing::Dispatch::new(tracing::subscriber::NoSubscriber::new()); as the first line of the main function, to create a dummy dispatcher, enough to avoid that optimization.
This bug is probably not present on the master branch given that the optimization doesn't exist on it. I don't know what your policy is, but given that 0.1 is still the only published branch, it would be nice to have a bugfix for this issue. If you think dropping the has_just_one optimization is acceptable and reasonable I'll happily make a PR for it.
Source: tokio-rs/tracing