Contents Menu Expand Light mode Dark mode Auto light/dark, in light mode Auto light/dark, in dark mode Skip to content
Python for Data Science
Logo
Python for Data Science
  • Introduction
  • Workspace
    • IPython
      • Start the IPython shell
      • IPython examples
      • IPython magic
      • Shell commands in IPython
      • Unix shell
        • Navigate through files and directories
        • Create, update and delete files and directories
        • Pipes and filters
        • grep and find
        • Shell variables
      • Show objects with display
      • foo.ipynb
      • Import notebooks
      • IPython extensions
      • Debugging
    • Jupyter
    • NumPy
      • Introduction to NumPy
      • ndarray – an N-dimensional array object
      • dtype
      • Arithmetic
      • Indexing and slicing
      • Transpose arrays and swap axes
      • Universal functions (ufunc)
      • Array-oriented programming – vectorisation
      • Conditional logic as array operations – where
      • Mathematical and statistical methods
      • Methods for Boolean arrays
      • Sort
      • unique and other set logic
      • File input and output with arrays
    • pandas
      • Introduction to the data structures of pandas
      • Converting Python data structures into pandas
      • Indexing
      • Date and Time
      • Selecting and filtering data
      • Adding, changing and deleting data
      • Manipulation of strings
      • Arithmetic
      • Descriptive statistics
      • Sorting and ranking
      • Subdividing and categorising data
      • Combining and merging data sets
      • Group operations
      • Aggregation
      • Apply
      • Pivot tables and crosstabs
      • Convert dtype
  • Read, persist and provide data
    • Open data
    • pandas IO tools
    • Serialisation formats
      • Data serialisation
      • CSV
        • CSV example
      • JSON
        • JSON example
      • Excel
      • XML/HTML
        • XML/HTML examples
        • BeautifulSoup
      • YAML
        • Example
      • TOML
        • Example
      • Pickle
        • Pickle examples
      • Protocol Buffers (Protobuf)
      • Other Formats
    • Intake
      • Install Intake
      • Intake for data scientists
      • Intake-GUI: Exploring data in a graphical user interface
      • Intake for data engineers
    • httpx
      • httpx installation and sample application
      • Create module
    • File systems
    • Geodata
    • PostgreSQL
      • Foreign Data Wrappers (FDW)
      • Procedural programming languages
      • DB-API 2.0
      • Psycopg
      • Object-relational mapping
      • SQLAlchemy
      • Alembic
      • ipython-sql
      • PostGIS
        • Install PostGIS
        • Optimising PostgreSQL for GIS database objects
        • Loading geospatial data
      • Database security
      • PostgreSQL performance
      • pgMonitor
      • pganalyze
    • NoSQL databases
      • Key-value database systems
      • Column-oriented database systems
      • Document-oriented database systems
      • Graph database systems
      • Object database systems
      • XML database systems
    • Application Programming Interface (API)
      • FastAPI
        • Installation
        • Example
        • Tips
        • Extensions
      • gRPC
        • gRPC-Example
        • Test gRPC
    • Glossary
  • Data cleansing and validation
    • Managing missing data with pandas
    • Detecting and filtering outliers
    • String comparisons
    • Deduplicate data
    • Hypothesis: Property-based testing
    • TDDA: Test-Driven Data Analysis
    • Data validation with Voluptuous (schema definitions)
    • Normalisation and Preprocessing
    • Assigning satellite data to geo-locations
  • Visualise data
  • Performance
    • cProfile/profiling.tracing
    • iPython Profiler
    • scalene
    • tprof
    • Memray
    • Tachyon
    • perflint
    • Parallelise pandas
    • Dask
    • Introduction to multithreading, multiprocessing and async
    • Threading example
    • Multi-processing example
    • Threading and forking combined
    • asyncio example
  • Create a product
    • Manage code with Git
      • Workspaces
      • Git installation and configuration
      • Working with Git
      • Review
      • Git tags
      • Git branches
      • Git rebase
      • Undo changes
      • Git best practices
      • Git workflows
        • Git Flow
        • Feature branch workflows
        • Deployment and release branches
        • Trunk Based Development
        • Merge strategies: merge vs. squash vs. rebase
        • Rewriting history
        • Monorepos and large repositories
        • Splitting and merging repos
        • CI-friendly Git Repos
      • Advanced Git
        • Git cherry-pick
        • Find regressions with git bisect
        • Git Notes
        • Git hooks
          • pre-commit framework
          • pre-commit scripts
          • Supported git hooks
          • pre-commit in CI pipelines
          • Skip hooks
          • Template for Git repositories
        • Jupyter Notebooks with Git
        • Shell configuration and command line tools
        • Batch processing
        • Git for binary files
        • Remove Git LFS
        • Visual Studio Code
          • GitLab VS Code Extension
        • GitLab
          • Roles, groups and permissions
          • Merge requests
          • GitLab CI/CD
            • GitLab Pages
            • npm deployment with rsync
            • Building Docker containers
            • Multi-arch images with Buildah
            • Migrating GitHub Actions
          • GitLab Package Registry
        • git-big-picture
        • etckeeper
        • Git Internals
      • Git glossary
    • Managing data with DVC
      • Create project
      • Manage data
      • Pipelines
      • Parameterisation
      • Metrics
      • Experiments
      • Display pipelines
      • Reproduce
      • Vim and IDE integration
      • FastDS
    • Python environments
      • uv
        • CI/CD pipelines
        • Dependency bot
        • Configuring Claude Code or Cursor for uv
        • Python Docker Container with uv
      • Spack
        • Spack installation
        • Combinatorial builds
        • Benefits of the build automation
        • Use case 1: managing combinatorial installations
        • Use case 2: Python and other interpreted languages
        • Future features
        • Use spack
        • Environments, spack.yaml and spack.lock
        • Spack mirrors
    • Creating programme libraries and packages
    • Document
    • Licensing
    • Citing
      • Cite data
      • Cite software
        • Create a DOI with Zenodo
        • CodeMeta
        • Citation File Format
        • Git2PROV
        • HERMES
      • Software journals
    • Testing
    • Logging
    • Check and improve code quality and complexity
      • Code-Smells and design principles
      • flake8
      • Mypy
      • Pytype
      • Wily
      • Pystra
      • Pysa
      • check-manifest
      • Ruff
      • Black
      • isort
      • prettier
      • Rope
    • Security
  • Create web applications
  • Index
Back to top
View this page

Page not found¶

This page may have been moved.

Please select a page from the side menu or visit our homepage at https://www.python4data.science/en/latest/.

Copyright © 2019–2025, Veit Schiele
Made with Sphinx and @pradyunsg's Furo