MCPcopy
hub / github.com/firecrawl/firecrawl / withMonitorScrapeDefaults

Function withMonitorScrapeDefaults

apps/api/src/services/monitoring/runner.ts:202–212  ·  view source on GitHub ↗
(
  options: Record<string, unknown>,
)

Source from the content-addressed store, hash-verified

200}
201
202function withMonitorScrapeDefaults(
203 options: Record<string, unknown>,
204): ScrapeOptions {
205 const formats = Array.isArray(options.formats)
206 ? normalizeMonitorFormats(options.formats)
207 : options.formats;
208 return {
209 maxAge: 0,
210 ...withMarkdownFormat({ ...options, formats }),
211 };
212}
213
214function getDocumentUrl(doc: any, fallback: string): string {
215 return doc?.metadata?.sourceURL ?? doc?.metadata?.url ?? doc?.url ?? fallback;

Callers 4

runSingleScrapeFunction · 0.85
runCrawlTargetFunction · 0.85

Calls 2

normalizeMonitorFormatsFunction · 0.90
withMarkdownFormatFunction · 0.90

Tested by

no test coverage detected

Used in the wild real call sites across dependent graphs

searching dependent graphs…