#5-14-18 - Disallowed Baiduspider as not respectful once starts following links # Removed some directories listed that no longer exist on the machine - comment for 5-14 made on 6-1 #Baiduspider User-agent: Baiduspider Disallow: / User-agent: Baiduspider-video Disallow: / User-agent: Baiduspider-image Disallow: / #EverythingElse User-agent: * Disallow: /*.txt Disallow: /*.gif Disallow: /*.jpg Disallow: /cc/ Disallow: /aspnet_client/ Disallow: /bin/ Disallow: /cgi-bin/ Disallow: /css/ Disallow: /images/ Disallow: /imgs/ Disallow: /includes/ Disallow: /scripts/ Disallow: /job-opportunities/ Disallow: /student-center/jrhigh-highscl/ Disallow: /student-center/images/ Disallow: /student-center/includes/ Disallow: /student-center/templates/ Disallow: /templates/ Disallow: /fac/images/ Disallow: /library-resources/ Disallow: /misc/ Disallow: /alliances-workshop/ Disallow: /functions/ Disallow: /state-by-state-accredsummary Disallow: /alliances2/ Disallow: /current-college-students/policy-interpretation.shtml Disallow: /current-college-students/interpretation-database.xls Disallow: /state-system/powerpoints/powerpoints.shtml Disallow: /state-system/powerpoints/powerpoints-legislative.shtml Disallow: /studies-reports/remediation/remediation-report-2-09.pdf Disallow: /transfer-students/faculty/ Disallow: /completion-conference Disallow: /oqs Disallow: /admin-fac/sara Disallow: /future/sc-materials/