Is this sentence grammatically correct ?

'Why didn't you come to office today ?'

Yes Richa, this sentence is grammatically correct. However an addition of the article 'the', would make it sound more case appropriate. Hence you can also say "Why didn't you come to the office today?".