Description
Pinky is a GitHub project designed to facilitate the interaction of AI agents with mobile phones, ensuring that the user remains in control throughout the process. This innovative framework allows AI agents to perform tasks on a user's phone, providing a unique blend of automation and human oversight. The project emphasizes a "human-in-the-loop" approach, meaning that while AI agents can execute actions, the user retains the ability to monitor and intervene as needed.
Read More
The repository includes various components, such as an Android companion app, UI elements, and worker processes, all contributing to the seamless integration of AI with mobile devices. It supports different operating systems, with specific fixes and requirements noted for macOS and Windows. The project's development is active, with recent commits addressing features like OCR engine sharing, Android companion app improvements, and UI enhancements.
Pinky aims to empower users by allowing AI agents to leverage phone capabilities for a wide range of applications, from automating routine tasks to assisting with complex operations. The architecture is designed to be flexible, enabling developers to build and deploy their own AI agents that can interact with the mobile environment. Documentation is provided in multiple languages, including English, Japanese, and Simplified Chinese, indicating a global reach and accessibility for developers worldwide.
The project's commitment to open-source development is evident through its GitHub presence, inviting contributions and fostering a community around AI-phone interaction. It provides a foundational layer for future innovations in personal AI assistants and automated mobile workflows, all while prioritizing user control and transparency.
- CategoryAI Agent Builders
- Pricing ModelOpen source
- DeploymentCloud, Self-hosted
- PlatformsAndroid, macOS, Windows
Pinky's Core Features
AI agents interact with your phone
Human-in-the-loop control for user oversight
Android companion application
UI for phone interaction visualization
Worker processes for task execution
OCR engine sharing between drivers
Support for macOS and Windows
Telemetry backend on Cloudflare Workers and D1
Multilingual documentation (English, Japanese, Chinese)
Release notes in Chinese for Chinese users
Finds and adds agents on the computer
Shared contracts and working rules for modules
Version control with Git attributes and ignore files
Makefile for build automation
Go modules for dependency management
Getting Started with Pinky
Clone the repository: Obtain the project files by cloning the Pinky GitHub repository to your local machine.
Install dependencies: Set up the necessary development environment and install any required Go modules or other dependencies.
Configure for your OS: Apply specific configurations or fixes relevant to your operating system, such as macOS or Windows.
Build the project: Use the provided Makefile or Go commands to build the Pinky application and its components.
Run the companion app: Deploy and run the Android companion app on your mobile device to enable phone interaction.
Integrate AI agents: Configure and integrate your AI agents to work with the Pinky framework, allowing them to utilize phone functionalities.
Monitor and control: Use the UI to monitor agent activities and maintain human-in-the-loop control over phone interactions.
Pinky's Use Cases
- Automated Mobile Tasks
- AI-Assisted Phone Operations
- Developer Prototyping
- Custom AI Agent Integration
- Enhanced Accessibility








