MCPcopy Create free account

hub / github.com/ScrapeGraphAI/scrapecraft / types & classes

Types & classes99 in github.com/ScrapeGraphAI/scrapecraft

⨍ Functions 307◇ Types & classes 99↳ Endpoints 44
↓ 7 callersClassScrapingService
Service for interacting with ScrapeGraphAI API.
backend/app/services/scrapegraph.py:8
↓ 6 callersClassConnectionManager
Manages WebSocket connections for real-time communication.
backend/app/services/websocket.py:7
↓ 4 callersClassURLInfo
Information about a URL in the pipeline.
backend/app/models/workflow.py:33
↓ 4 callersClassURLInfo
Information about a URL.
backend/app/agents/langgraph_agent.py:35
↓ 3 callersClassConversationContext
Context for a conversation thread.
backend/app/agents/unified_agent.py:21
↓ 3 callersClassSchemaField
Schema field definition.
backend/app/models/workflow.py:44
↓ 2 callersClassAPIError
API-related errors (500, 503, etc.).
backend/app/services/scraping_service_enhanced.py:30
↓ 2 callersClassIntent
Analyzed user intent.
backend/app/agents/unified_agent.py:34
↓ 2 callersClassScrapeCraftAgent
LangGraph-based agent for web scraping pipelines.
backend/app/agents/langgraph_agent.py:94
↓ 2 callersClassScrapingError
Base exception for scraping errors.
backend/app/services/scraping_service_enhanced.py:25
↓ 2 callersClassWorkflowPhase
Workflow phases for the scraping pipeline.
backend/app/models/workflow.py:10
↓ 2 callersClassWorkflowState
Complete workflow state.
backend/app/models/workflow.py:65
↓ 2 callersClassWorkflowTransition
Represents a transition between workflow phases.
backend/app/models/workflow.py:24
↓ 1 callersClassApprovalRequest
Request for user approval.
backend/app/models/workflow.py:54
↓ 1 callersClassEnhancedScrapingService
Enhanced service for ScrapeGraphAI with retry and error handling.
backend/app/services/scraping_service_enhanced.py:40
↓ 1 callersClassEnhancedWebSocketManager
Enhanced WebSocket manager with streaming and collaboration features.
backend/app/services/enhanced_websocket.py:79
↓ 1 callersClassEnhancedWorkflowManager
Enhanced workflow manager supporting multiple agent implementations.
backend/app/services/workflow_manager_v2.py:21
↓ 1 callersClassExecuteResponse
backend/app/api/execution.py:27
↓ 1 callersClassKimiScrapingAgent
backend/app/agents/kimi_agent.py:12
↓ 1 callersClassMessageResponse
backend/app/api/chat.py:18
↓ 1 callersClassOpenRouterAgent
backend/app/agents/openrouter_agent.py:10
↓ 1 callersClassPatternLearner
Service for learning from scraping patterns and improving suggestions.
backend/app/services/pattern_learner.py:78
↓ 1 callersClassPipeline
backend/app/models/pipeline.py:13
↓ 1 callersClassRateLimitError
Rate limit exceeded error.
backend/app/services/scraping_service_enhanced.py:35
↓ 1 callersClassSchemaField
Schema field definition.
backend/app/agents/langgraph_agent.py:44
↓ 1 callersClassScrapingAgent
backend/app/agents/scraping_agent.py:28
↓ 1 callersClassScrapingResponse
backend/app/api/scraping.py:17
↓ 1 callersClassSettings
backend/app/config.py:4
↓ 1 callersClassSimpleScrapingAgent
backend/app/agents/simple_agent.py:5
↓ 1 callersClassStreamingResponse
Helper for streaming responses.
backend/app/services/enhanced_websocket.py:43
↓ 1 callersClassTokenData
backend/app/api/auth.py:23
↓ 1 callersClassToolBasedScrapingAgent
LangGraph agent using tools for web scraping.
backend/app/agents/langgraph_tools_agent.py:40
↓ 1 callersClassUnifiedScrapingAgent
Unified conversational agent that acts like Cursor for web scraping. Maintains context, learns from patterns, and creates reusable pipelines.
backend/app/agents/unified_agent.py:43
↓ 1 callersClassUser
backend/app/api/auth.py:26
↓ 1 callersClassUserInDB
backend/app/api/auth.py:32
↓ 1 callersClassWorkflowManager
Manages workflow states and coordinates between agent and frontend.
backend/app/services/workflow_manager.py:17
ClassAPIKeyCreate
backend/app/api/auth.py:41
ClassAgentState
State for the LangGraph agent.
backend/app/agents/langgraph_agent.py:53
ClassAgentState
State for the tool-based agent.
backend/app/agents/langgraph_tools_agent.py:30
ClassAgentState
backend/app/agents/scraping_agent.py:18
InterfaceApprovalDialogProps
frontend/src/components/Workflow/ApprovalDialog.tsx:5
ClassApprovalRequest
Approval request.
backend/app/api/workflow.py:33
InterfaceApprovalRequest
frontend/src/store/workflowStore.ts:35
InterfaceButtonProps
frontend/src/components/Common/Button.tsx:4
ClassChatMessage
backend/app/models/chat.py:11
InterfaceChatMessage
frontend/src/types/index.ts:2
ClassChatResponse
backend/app/models/chat.py:18
InterfaceChatState
frontend/src/store/chatStore.ts:15
ClassConfig
backend/app/config.py:31
ClassConfig
backend/app/models/workflow.py:187
ClassConversationHistory
backend/app/models/chat.py:24
ClassDomainKnowledge
Domain-specific knowledge base.
backend/app/services/pattern_learner.py:46
ClassExecuteRequest
backend/app/api/execution.py:20
InterfaceInputProps
frontend/src/components/Common/Input.tsx:4
InterfaceLoadingSpinnerProps
frontend/src/components/Common/LoadingSpinner.tsx:3
ClassMarkdownifyInput
Input schema for Markdownify tool.
backend/app/agents/tools/scraping_tools.py:37
InterfaceMessageBubbleProps
frontend/src/components/Chat/MessageBubble.tsx:9
ClassMessageRequest
backend/app/api/chat.py:13
ClassMessageRole
backend/app/models/chat.py:6
ClassMessageType
WebSocket message types.
backend/app/services/enhanced_websocket.py:14
InterfacePipeline
frontend/src/types/index.ts:14
ClassPipelineCreate
backend/app/models/pipeline.py:27
InterfacePipelineCreate
frontend/src/types/index.ts:30
ClassPipelineExecution
backend/app/models/pipeline.py:40
InterfacePipelineState
frontend/src/store/pipelineStore.ts:5
ClassPipelineStatus
backend/app/models/pipeline.py:6
ClassPipelineUpdate
backend/app/models/pipeline.py:33
InterfacePipelineUpdate
frontend/src/types/index.ts:37
ClassSchemaField
backend/app/agents/tools.py:9
InterfaceSchemaField
frontend/src/components/Pipeline/SchemaEditor.tsx:6
InterfaceSchemaField
frontend/src/store/workflowStore.ts:27
ClassSchemaFieldUpdate
Schema field update request.
backend/app/api/workflow.py:24
ClassSchemaInput
backend/app/agents/tools.py:14
ClassScrapingPattern
Model for learned scraping patterns.
backend/app/services/pattern_learner.py:18
ClassScrapingRequest
backend/app/api/scraping.py:12
ClassScrapingResult
backend/app/api/scraping.py:22
InterfaceScrapingResult
frontend/src/types/index.ts:75
ClassSearchResults
backend/app/services/scrapegraph.py:92
ClassSearchScraperInput
Input schema for SearchScraper tool.
backend/app/agents/tools/scraping_tools.py:31
InterfaceSettingsModalProps
frontend/src/components/Settings/SettingsModal.tsx:6
ClassSmartCrawlerInput
Input schema for SmartCrawler tool.
backend/app/agents/tools/scraping_tools.py:23
ClassSmartScraperInput
Input schema for SmartScraper tool.
backend/app/agents/tools/scraping_tools.py:17
InterfaceStreamingMessageProps
frontend/src/components/Chat/StreamingMessage.tsx:6
ClassToken
backend/app/api/auth.py:19
InterfaceURLInfo
frontend/src/store/workflowStore.ts:17
ClassURLInput
backend/app/agents/tools.py:6
ClassURLUpdate
URL update request.
backend/app/api/workflow.py:16
InterfaceUser
frontend/src/types/index.ts:83
ClassUserCreate
backend/app/api/auth.py:35
InterfaceWSEvents
frontend/src/types/index.ts:46
InterfaceWebSocketState
frontend/src/store/websocketStore.ts:5
ClassWebsiteInfo
backend/app/services/scrapegraph.py:87
ClassWorkflowPhase
Workflow phases for the scraping pipeline.
backend/app/agents/langgraph_agent.py:21
EnumWorkflowPhase
frontend/src/store/workflowStore.ts:None
InterfaceWorkflowPhase
frontend/src/components/Workflow/WorkflowSidebar.tsx:6
InterfaceWorkflowState
frontend/src/components/Workflow/WorkflowSidebar.tsx:14
InterfaceWorkflowState
frontend/src/store/workflowStore.ts:53
InterfaceWorkflowStore
frontend/src/store/workflowStore.ts:75
InterfaceWorkflowTransition
frontend/src/store/workflowStore.ts:45