It looks like there is a book off in NY.
BOOKOFF New York Store | BOOKOFF
I used to go to the Costa Mesa (CA) one all the time and they had quite a selection of music, books, movies, and magazines. I'd bet there will be some J-rock CDs at the NY store as well. If there is something in particular you are looking for, why don't you give them a call?
Some advice: Used CDs are WAY cheaper than new CDs. New CDs have the import charge as well as the ridiculous Japanese cost of CDs attached to them making them $30-50. I've gotten used CDs for $1-10. Of course the older and less popular they are, the cheaper they will be. Even if they're not good or popular, if they are new they will have quite the price tag.