Did you guys go beyond your allotted time? If your hour wasn't up and he was checking his phone and answering the door, that's pretty unprofessional.
Cleanliness is something I'd expect, but wouldn't necessarily be a deal breaker unless it was bad. Weed is legal in CA so that doesn't put me off either, but overall I'd say to just leave an honest review so that others can be warned.