Muck the area up with thick grease, such as wheel bearing grease and work on it with a large diameter rat-tail file. The grease will retain the filings. If you use a grinder to relieve it, you'll throw debris everywhere.