# Website Crawler ## Overview The Website Crawler source connector allows you to extract data from Websites into your desired vector database. This helps you to automatically access the content contained in web pages and convert it into embeddings for loading into the vector database. ## Configuration Options * **Name:** This field represents the name you want to assign to the actor instance responsible for managing the Website Crawler source. Choose a descriptive and unique name to easily identify this instance within your data activation tool (dat). * **Site URL:** Enter the Site URL. like [https://www.example.com](https://www.example.com/). ## Supported streams The following streams are supported for this source: * url\_crawler --- # Agent Instructions: Querying This Documentation If you need additional information that is not directly available in this page, you can query the documentation dynamically by asking a question. Perform an HTTP GET request on the current page URL with the `ask` query parameter: ``` GET https://docs.dat-hub.com/integrations/sources/website-crawler.md?ask= ``` The question should be specific, self-contained, and written in natural language. The response will contain a direct answer to the question and relevant excerpts and sources from the documentation. Use this mechanism when the answer is not explicitly present in the current page, you need clarification or additional context, or you want to retrieve related documentation sections.