Set params function for inference configs

Describe the workflow you want to enable

The inference config parameter is an object which makes it hard to use cross validation, could we add a way to set the parameters through separate keys?

Describe your proposed solution

Modify the set_params function to allows for sub-keys of the inference configs object

Describe alternatives you've considered, if relevant

No response

Additional context

No response

Impact

None