A good razor scraper should help but it will still be a chore. You can usually rent these at a tool rental company. Try cutting score lines in it so that when you do scrape it up it comes up in strips. A heat gun might also be an option to help loosen the adhesive depending on exactly which type was used. Just be sure the heat gun doesntget too hot and melt the linoluem. Here's a link to picture of the type of scraper I use these can be purchased locally at flooring supply stores if you can't rent. GOOD LUCK,AC
Extendable Floor Scraper with 8" Blade