A Python package for AI tools using LLM.
- Compliance Checker: Analyze videos for regulatory compliance
- HealthScribe: Medical transcription using AWS HealthScribe
- Differential Diagnosis (DDx) Assistant: Get assistance with clinical diagnosis
- Excel Formula Generator AI Assistant: Get assistance with Excel Formulas
- Medical Bill Extractor: Extract and analyze data from medical bills
- Coding Assistant: Analyze code and help you with coding as debugger
- Speech to speech assistant: Real-time voice interactive assistant
- PII Redactor AI assistant: Analyze text and remove PII (personally identifiable information) from the text
- PII extractor AI assistant: Analyze text and extract PII (personally identifiable information) from the text
pip install newberryaiYou can use the command-line interface:
newberryai <command> [options]
Available commands:
-
compliance- Run compliance check on medical videos -
healthscribe- Transcribe medical conversations -
ddx- Get differential diagnosis assistance -
ExcelO- Get excel formula AI assistance -
bill_extract- Extract and analyze medical bill data -
coder- Analyze code and help you with coding as debugger -
speech_to_speech- Launch the real-time Speech-to-Speech assistant. -
PII_Red- Analyze text and remove PII from the text using AI. -
PII_extract- Analyze text and extract PII from the text using AI.
newberryai compliance --video_file /path/to/video.mp4 --question "Is the video compliant with safety regulations such as mask?"newberryai healthscribe --file_path conversation.wav \
--job_name myJob \
--data_access_role_arn arn:aws:iam::aws_accountid:role/your-role \
--input_s3_bucket my-input-bucket \
--output_s3_bucket my-output-bucket \
--s3_key s3-key# With a specific clinical indication
newberryai ddx --clinical_indication "Patient presents with fever, cough, and fatigue for 5 days"
# Interactive CLI mode
newberryai ddx --interactive
# Launch Gradio web interface
newberryai ddx --gradio# With a specific Excel Query
newberryai ExcelO --Excel_query "Calculate average sales for products that meet specific criteria E.g: give me excel formula to calculate average of my sale for year 2010,2011 sales is in col A, Year in Col B and Months in Col C"
# Interactive CLI mode
newberryai ExcelO --interactive
# Launch Gradio web interface
newberryai ExcelO --gradio# Analyze a specific document
newberryai bill_extract --image_path /path/to/medical_bill.pdf
# Interactive CLI mode
newberryai bill_extract --interactive
# Launch Gradio web interface
newberryai bill_extract --gradio# With a specific python coding Query
newberryai coder --code_query " your Query related to your python code"
# Interactive CLI mode
newberryai coder --interactive
# Launch Gradio web interface
newberryai coder --gradio# With a specific Text
newberryai PII_Red --text " your text containing PII."
# Interactive CLI mode
newberryai PII_Red --interactive
# Launch Gradio web interface
newberryai PII_Red --gradio# With a specific Text
newberryai PII_extract --text " your text containing PII."
# Interactive CLI mode
newberryai PII_extract --interactive
# Launch Gradio web interface
newberryai PII_extract --gradio# Launch the real-time speech-to-speech application
newberryai speech_to_speechYou can also use NewberryAI as a Python module in your applications.
from newberryai import HealthScribe
import os
import newberryai
# Set the environment variables for the AWS SDK
os.environ['AWS_ACCESS_KEY_ID'] = 'your_aws_access_key_id'
os.environ['AWS_SECRET_ACCESS_KEY'] = 'your_aws_secret_access_key'
os.environ['AWS_REGION'] = 'your_aws_region'
# Initialize the client
scribe = HealthScribe(
input_s3_bucket="input-bucket",
data_access_role_arn="arn:aws:iam::12345678912:role/your_role"
)
# Process an audio file
result = scribe.process(
file_path="/path/to/audio_file.mp3",
job_name="test_job_1",
output_s3_bucket="output-bucket"
)
# Use the summary
print(result.summary)from newberryai import ComplianceChecker
checker = ComplianceChecker()
video_file = "/path/to/video.mp4"
compliance_question = "Is the video compliant with safety regulations such as mask?"
# Call the compliance-checker function
result, status_code = checker.check_compliance(
video_file=video_file,
question=compliance_question
)
# Check for errors
if status_code:
print(f"Error: {result.get('error', 'Unknown error')}")
else:
# Print the compliance check result
print(f"Compliant: {'Yes' if result['compliant'] else 'No'}")
print(f"Analysis: {result['analysis']}")from newberryai import DDxChat
# Initialize the DDx Assistant
ddx_chat = DDxChat()
# Ask a specific clinical question
response = ddx_chat.ask("Patient presents with fever, cough, and fatigue for 5 days")
print(response)
# Alternatively, launch interactive CLI
# ddx_chat.run_cli()
# Or launch the Gradio web interface
# ddx_chat.start_gradio()from newberryai import ExcelExp
# Initialize the DDx Assistant
excel_expert = ExcelExp()
# Ask a specific clinical question
response = excel_expert.ask("Calculate average sales for products that meet specific criteria E.g: give me excel formula to calculate average of my sale for year 2010,2011 sales is in col A, Year in Col B and Months in Col C")
print(response)
# Alternatively, launch interactive CLI
# excel_expert.run_cli()
# Or launch the Gradio web interface
# excel_expert.start_gradio()from newberryai import Bill_extractor
# Initialize the Bill Extractor
extractor = Bill_extractor()
# Analyze a document
analysis = extractor.analyze_document("/path/to/medical_bill.pdf")
print(analysis)
# Alternatively, launch interactive CLI
# extractor.run_cli()
# Or launch the Gradio web interface
# extractor.start_gradio()from newberryai import CodeReviewAssistant
# Initialize the DDx Assistant
code_debugger = CodeReviewAssistant()
# Ask a specific clinical question
response = code_debugger.ask("""Explain and correct below code
def calculate_average(nums):
sum = 0
for num in nums:
sum += num
average = sum / len(nums)
return average
numbers = [10, 20, 30, 40, 50]
result = calculate_average(numbers)
print(“The average is:”, results)""")
print(response)
# Alternatively, launch interactive CLI
# code_debugger.run_cli()
# Or launch the Gradio web interface
# code_debugger.start_gradio()from newberryai import RealtimeApp
# Initialize and run the speech-to-speech assistant
app = RealtimeApp()
app.run()from newberryai import PII_Redaction
# Initialize the PII Redactor Assistant
pii_red = PII_Redaction()
# Provide a text to detect PII
response = pii_red.ask("Patient name is John Doe with fever. he is from Austin,Texas.His email id is john.doe14@email.com")
print(response)
# Alternatively, launch interactive CLI
# pii_red.run_cli()
# Or launch the Gradio web interface
# pii_red.start_gradio()from newberryai import PII_extraction
# Initialize the PII Extraction Assistant
pii_extract = PII_extraction()
# Provide a text to detect PII
response = pii_extract.ask("Patient name is John Doe with fever. he is from Austin,Texas.His email id is john.doe14@email.com")
print(response)
# Alternatively, launch interactive CLI
# pii_extract.run_cli()
# Or launch the Gradio web interface
# pii_extract.start_gradio()If you encounter SSL certificate errors while running NewberryAI, you can fix them by running:
pip install --upgrade certifi
export SSL_CERT_FILE=$(python -c "import certifi; print(certifi.where())")This ensures that your system is using the latest SSL certificates.
To use OpenAI's Speech-to-Speech features, you need to set your API key as an environment variable.
-
Get your API key from https://platform.openai.com/account/api-keys
-
Set the environment variable in your terminal or shell configuration file.
export OPENAI_API_KEY="your-api-key-here"You can add this line to your ~/.bashrc, ~/.bash_profile, or ~/.zshrc file to make it permanent.
set OPENAI_API_KEY=your-api-key-here$env:OPENAI_API_KEY="your-api-key-here"- Verify it's set by running:
echo $OPENAI_API_KEY- Python 3.8+
- OpenAI account with Api keys
- AWS account with appropriate permissions
- Required AWS services:
- Amazon S3
- AWS HealthScribe
- AWS IAM
To use the AWS-powered features, you need to set up the following:
- An AWS account with appropriate permissions
- AWS IAM role with access to required services
- S3 buckets for input and output data
- AWS credentials configured in your environment
This project is licensed under the MIT License.