Assuming the birthrate stabilizes, that would be fine in the long run. The biggest concern is too many old people and not enough young workers, and the government no longer able to support the socialized medicine and pension ponzi schemes.

(don't take this clarification to mean I believe the globohomo agenda to wipe out Japanese culture isn't a worse problem)