The 'place' he is referring to was within him but it has been forgotten for so long. He has forgot how he used to be a child and all that is left is his maturity as the childishness he had is gone to a place within him that is long forgotten.
(Hope this answer helped you some how)