You're so lucky to have seen him! At least you know he is okay, for now. He has definitely not forgotten you, he is just listening to his instincts which tell him that in this new, strange environment, everything is a threat - even you! He will revert back to his normal behavior when he gets back home. Cats don't forget their loved ones easily.
Smelly, delicious fish is the best way to lure a cat that's scared of you. But it takes time, patience and lots and lots of delicious fish. If you ever change your mind and manage to take time off work, or if you go there on the weekends, this is what you should do. Also, if you ever do see him, act as normal as possible - or he may run away again. He needs to come to you on his own - it's not easy to catch a cat. Right now, he may not be that hungry, but in a few days he will be starving and will be more likely to come to you.
Please do read about lost cat behavior to see where he might be, there are many different cat personalities and they all react differently in a situation like this:
http://www.bestfriends.org/nomorehom...605lostcat.pdf