Project Overview

Duration

• Jun 2023 - Jun 2023

Client

• Client: Fintech

• Repository Type: Private

Technologies

• Languages: Python

• Database: PostgreSQL

• Version Control: Git, GitHub

• Testing: Pytest

• Data Manipulation: Pandas, NumPy

• Web Scraping and NLP: OpenAI, BeautifulSoup, PyPDF, Urllib, Requests

Project Details

Description

Contributed to a private repository for a fintech client by developing a sentiment analysis tool. The project involved utilizing Python for scripting, PostgreSQL for data storage, and Git and GitHub for version control. Comprehensive testing was conducted using Pytest, and data manipulation tasks were performed with Pandas and NumPy. OpenAI, BeautifulSoup, PyPDF, Urllib, and Requests were integrated for web scraping and natural language processing tasks.

Design and Coding (Beautiful Soup, Selenium, PostgreSQL, SQL)

• Beautiful Soup and Selenium:

  • Designed a well-organized structure for web scraping.

• PostgreSQL and SQL:

  • Utilized PostgreSQL for data storage.

  • Used SQL for interacting with the database.

Testing (Pytest)

• Implemented Pytest for extensive testing, generating coverage reports to ensure the project's reliability.

Documentation

• Maintained a detailed directory structure.

• Utilized a virtual environment for dependency management, contributing to the project's organization.