Introduction PART I: FUNDAMENTAL CONCEPTS AND TECHNIQUES Chapter 1: What's in It for You? Chapter 2: Ideas for Webbots Chapter 3: Downloading Web Pages Chapter 4: Parsing Techniques Chapter 5: Automating Form Submission Chapter 6: Managing Large Amounts of Data PART II: PROJECTS Chapter 7: Price-Monitoring Webbots Chapter 8: Image-Capturing Webbots Chapter 9: Link-Verification Webbots Chapter 10: Anonymous Browsing Webbots Chapter 11: Search-Ranking Webbots Chapter 12: Aggregation Webbots Chapter 13: FTP Webbots Chapter 14: NNTP News Webbots Chapter 15: Webbots That Read Email Chapter 16: Webbots That Send Email Chapter 17: Converting a Website into a Function PART III: ADVANCED TECHNICAL CONSIDERATIONS Chapter 18: Spiders Chapter 19: Procurement Webbots and Snipers Chapter 20: Webbots and Cryptography Chapter 21: Authentication Chapter 22: Advanced Cookie Management Chapter 23: Scheduling Webbots and Spiders PART IV: LARGER CONSIDERATIONS Chapter 24: Designing Stealthy Webbots and Spiders Chapter 25: Writing Fault-Tolerant Webbots Chapter 26: Designing Webbot-Friendly Websites Chapter 27: Killing Spiders Chapter 28: Keeping Webbots out of Trouble Appendix A: PHP/CURL Reference Appendix B: Status Codes Appendix C: SMS Email Addresses Index