I believe there are some equations to estimate RMS from PSD, I think there is something on it in the New Manual of Observatory Practice.
And computing RMS from the time series data should be trivial using numpy, I believe? If you want a certain frequency band you could filter before doing the RMS calculation.