Man if I were you I'd write a chorus and call it good.
A song doesnt have to be long and sometimes that wrecks them. They turn into short stories and nobody even remembers what it was all about.
Personally I find it easier to write a song around the hook line which comes first and not vice versa. It can be done the other way though.
Good job.