Carpool lane Entering/Exiting?

I live off the 14 freeway in california and on the 14 the carpool lane is only an HOV lane from either 5-9am (South) or 3-7pm (North). Is it legal to exit the carpool lane over the double yellow line if it is not during these times (e.g. 8pm)?