TLDR

Prior to delving straight into the creation of Python packages, let's first grasp the concept of Modular programming.

Modular programming refers to the process of breaking a large, unwieldy programming task into separate, smaller, more manageable subtasks or modules. Individual modules can then be cobbled together like building blocks to create a larger application.

So, what are the example for modular programing in python?
Functions, modules and packages are all constructs in Python that promote code modularization.

NICE!!

You may already know what is a function in python, but did you get confused thinking what is the difference between module and package in python?

Suppose you have developed a very large application that includes many modules. As the number of modules grows, it becomes difficult to keep track of them all if they are dumped into one location. This is particularly so if they have similar names or functionality. You might wish for a means of grouping and organizing them.

In this case Packages allow for a hierarchical structuring of the module namespace using dot notation.

OK, that great! Let's think we have some modules available; Now let's see how we can create a package out of it!

Python packages are created using python packaging tools like setuptools, Flit, PDM, Poetry etc..

Python setuptools is a widely used tool for packaging Python projects. Today our plan is to create package using setuptools.

Step 1 : Setup your environment

• Upgrade pip tool

python -m pip install --upgrade pip

• Upgrade Build

python -m pip install --upgrade build

This installs following packages in your machine build-0.10.0, packaging-23.1, pyproject_hooks-1.0.0, tomli-2.0.1

Build package is used to build the python package

• Install setuptools

pip install setuptools

you can read about setuptools in the link https://pypi.org/project/setuptools/

• Install twine tool

pip install twine

Step 2 : Create folder structure as shown below

Here I created a master folder call sunish_package under it another folder level src/sunish_package and test

Also you can I created files called LICENSE, ReadME and pyproject.toml

Step 3: Add modules

Under the folder src/sunish_package i created two files with name init.py and mdoule_1.py

• init.py is the Package Initialization script, it can be empty
• module_1.py is our module with test code

def test_function():
    print("Hello World")

Step 4: Update pyproject.toml file

In older version of setuptool the user need to create setup.py script in the root location of the package which contains all the configuration for the package, but starting from setuptools version 58.0.0, it introduced support for reading package metadata and build configurations from the pyproject.toml file.

[build-system]
requires = ["setuptools>=61.0"]
build-backend = "setuptools.build_meta"

[project]
name = "sunish_package"
version = "0.0.1"
authors = [
  { name="Example Author", email="author@example.com" },
]
description = "A small example package"
readme = "README.md"
requires-python = ">=3.7"
classifiers = [
    "Programming Language :: Python :: 3",
    "License :: OSI Approved :: MIT License",
    "Operating System :: OS Independent",
]

[project.urls]
"Homepage" = "https://github.com/pypa/sampleproject"
"Bug Tracker" = "https://github.com/pypa/sampleproject/issues"

The important thing to note here is the name of the package, it should be pointing to the same folder name under src. Also you can see under [build-system] title I have filled requires section as setuptools. This indicate the python package need to be build using the setuptools.

Step 5: Update LICESNSE and ReadME.md

ReadME.md

# About Package

This is an example package

LICESNSE

Copyright (c) 2023 Sunish.

I prefer you to use correct License and update ReadME with your package information. Since I am creating a test package, here I am filling it with basic information.

Step 6 : Create Python Package

Go to your root folder and run the below command.

python -m build .

This created two folders called dist and sunish_package.egg-info

Whl file is the file we want, the python packages are packaged in the forrmat called wheels (.whl)

Step 7 : Import and test

Go the dist folder and install the package using pip

pip install .\sunish_package-0.0.1-py3-none-any.whl

you can check the package is listing in the pipe list with below command

pip list -v

Now open a python console and import our new package

from sunish_package import module_1
module_1.test_function()

SUCCESS!! it prints "hello world" as expected.

Step 8 : Push the package to internal artifactory python repository

In order to push the package to our internal artifactory we make use of the tool Twine.

Create the .pypirc file in the dist folder and update the artifactory url , username and password

[distutils]

index-servers = local

[local]

repository: http://localhost:8081/artifactory/api/pypi/pypi

username: <user_name>

password: <password>

Then run the below command to push the package to the artifactory repo

twine upload -r local <PATH_TO_THE_FILES> --config-file ~/.pypirc