@em3odme/agentic 0.1.0

package/LICENSE.md

@@ -0,0 +1,21 @@
+MIT License
+
+Copyright (c) 2026 Roman Jankowski
+
+Permission is hereby granted, free of charge, to any person obtaining a copy
+of this software and associated documentation files (the "Software"), to deal
+in the Software without restriction, including without limitation the rights
+to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
+copies of the Software, and to permit persons to whom the Software is
+furnished to do so, subject to the following conditions:
+
+The above copyright notice and this permission notice shall be included in all
+copies or substantial portions of the Software.
+
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
+FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
+AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
+LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
+OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
+SOFTWARE.

package/README.md

@@ -0,0 +1,145 @@
+# Agentic
+
+A TypeScript library for running AI models across multiple providers with a unified interface.
+
+## Overview
+
+Agentic provides a simple, consistent API for interacting with various AI providers including Cloudflare Workers AI and Groq. It handles provider-specific execution logic, retry logic with exponential backoff, JSON mode, tool calling, and response formatting.
+
+## Installation
+
+```bash
+npm install @em3odme/agentic
+pnpm install @em3odme/agentic
+yarn add @em3odme/agentic
+```
+
+**Requirements:** Node.js >= 18.0.0
+
+## Quick Start
+
+```typescript
+import { ModelRunner, groqAIModel } from '@em3odme/agentic';
+
+const runner = new ModelRunner({
+  GROQ_API_KEY: process.env.GROQ_API_KEY!,
+});
+
+const result = await runner.run({
+  messages: [{ role: 'user', content: 'Hello, how are you?' }],
+  model: groqAIModel('llama-3.3-70b-versatile'),
+});
+
+console.log(result.content);
+```
+
+## Supported Providers
+
+| Provider                                              | JSON Mode | Tools | Streaming | Setup          |
+| ----------------------------------------------------- | --------- | ----- | --------- | -------------- |
+| [Cloudflare Workers AI](./docs/CloudflareProvider.md) | ✓         | ✓     | ✗         | `AI` binding   |
+| [Groq](./docs/GroqProvider.md)                        | ✓         | ✓     | ✓         | `GROQ_API_KEY` |
+
+### Cloudflare Workers AI
+
+Run open-source models (Llama, DeepSeek, Mistral, etc.) on Cloudflare's global edge network.
+
+```typescript
+import { ModelRunner, cloudflareAIModel } from '@em3odme/agentic';
+
+const runner = new ModelRunner({ AI: env.AI });
+
+const result = await runner.run({
+  messages: [{ role: 'user', content: 'Hello!' }],
+  model: cloudflareAIModel('@cf/meta/llama-3.3-70b-instruct-fp8-fast'),
+});
+```
+
+**Features:**
+
+- Serverless GPU infrastructure
+- JSON mode for structured responses
+- Function calling capabilities
+- Embedding models support
+- Automatic retries with exponential backoff
+
+### Groq
+
+High-performance LLM inference with ultra-low latency.
+
+```typescript
+import { ModelRunner, groqAIModel } from '@em3odme/agentic';
+
+const runner = new ModelRunner({
+  GROQ_API_KEY: process.env.GROQ_API_KEY!,
+});
+
+const result = await runner.run({
+  messages: [{ role: 'user', content: 'Hello!' }],
+  model: groqAIModel('llama-3.3-70b-versatile'),
+});
+```
+
+**Features:**
+
+- Real-time streaming responses
+- JSON mode for structured outputs
+- Tool/function calling
+- Speech recognition (Whisper models)
+- Ultra-fast inference
+
+## Usage Examples
+
+### JSON Mode
+
+```typescript
+const result = await runner.run({
+  messages: [{ role: 'user', content: 'List top 3 programming languages' }],
+  model: groqAIModel('llama-3.3-70b-versatile'),
+  jsonMode: true,
+});
+
+const languages = JSON.parse(result.content);
+```
+
+### Tool Calling
+
+```typescript
+const result = await runner.run({
+  messages: [{ role: 'user', content: 'What is the weather in New York?' }],
+  model: groqAIModel('llama-3.3-70b-versatile'),
+  options: { tools: true },
+});
+
+console.log(result.tool_calls);
+```
+
+### Runtime Configuration
+
+```typescript
+ModelRunner.updateRuntimeConfig({
+  timeout: 60000,
+  retries: {
+    maxAttempts: 5,
+    baseDelay: 1000,
+    maxDelay: 10000,
+  },
+});
+```
+
+## Documentation
+
+For detailed documentation, see:
+
+- [ModelRunner Documentation](./docs/ModelRunner.md) - Core API reference
+- [Cloudflare Provider](./docs/CloudflareProvider.md) - Cloudflare Workers AI setup and usage
+- [Groq Provider](./docs/GroqProvider.md) - Groq API setup and usage
+
+## Package Info
+
+- **Repository:** https://github.com/Em3ODMe/agentic.git
+- **Issues:** https://github.com/Em3ODMe/agentic/issues
+
+## Keywords
+
+agent, llm, ai, typescript, nodejs