Hacks #8-32 Perl Modules Resources You May Find Helpful Hack 8. Installing Perl Modules Hack 9. Simply Fetching with LWP::Simple Hack 10. More Involved Requests with LWP::UserAgent Hack 11. Adding HTTP Headers to Your Request Hack 12. Posting Form Data with LWP Hack 13. Authentication, Cookies, and Proxies Hack 14. Handling Relative and Absolute URLs Hack 15. Secured Access and Browser Attributes Hack 16. Respecting Your Scrapee's Bandwidth Hack 17. Respecting robots.txt Hack 18. Adding Progress Bars to Your Scripts Hack 19. Scraping with HTML::TreeBuilder Hack 20. Parsing with HTML::TokeParser Hack 21. WWW::Mechanize 101 Hack 22. Scraping with WWW::Mechanize Hack 23. In Praise of Regular Expressions Hack 24. Painless RSS with Template::Extract Hack 25. A Quick Introduction to XPath Hack 26. Downloading with curl and wget Hack 27. More Advanced wget Techniques Hack 28. Using Pipes to Chain Commands Hack 29. Running Multiple Utilities at Once Hack 30. Utilizing the Web Scraping Proxy Hack 31. Being Warned When Things Go Wrong Hack 32. Being Adaptive to Site Redesigns |