B. Problems crawling and capturing live content from the web

Refer to the sections below for descriptions of issues known to NYARC to negatively effect quality at the web crawling phase, and for their respective recommended responses:

• • B1: Responsive content

  • B2: Obstructed content

  • B3: Questionable markup

  • Capturing content with Conifer and/or Webrecorder

Note that the above issues and improvement strategies reflect the experience of NYARC alone. They are not meant to represent a comprehensive inventory of web archiving community issues, nor necessarily of the strategies recommended by Archive-It.