Skip to content

List of resources for mineral exploration and machine learning, generally with useful code and examples.

Notifications You must be signed in to change notification settings

RichardScottOZ/mineral-exploration-machine-learning

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 

Repository files navigation

mineral-exploration-machine-learning

This page lists resources for mineral exploration and machine learning, generally with useful code and examples. ML and Data Science is a huge field, these are resources I have found useful and/or interesting to me in practice. Links currently to a fork of a repository are because I have changed something to use and put in a list for reference. Resources are also given for data analysis, transformation and visualisation as that is most of the work.

Suggestions welcome: open a discussion, issue or pull request.

Table of Contents

Map

Frameworks

R

  • CAST -> Caret Applications for Spatio-Temporal models
  • geodl -> semantic segmentation of geospatial data using convolutional neural network-based deep learning

Pipelines

  • geotargts -> Extension of targets to terra and stars

Prospectivity

Australia

Explorer Challenge

South Australia

Explore SA - South Australian Department of Energy and Mining Competition

North America

Canada

South America

Brazil

China

Sudan

Norway

Geology

Training Data

Lithology

Drilling

  • Heterogenous Drilling - Nicta/Data61 project report for looking at modelling using drillholes that don't go far enough
  • corel -> smart computer vision model that identifies facies and performs rock typing on core images

Paleovalleys

Stratigraphy

  • Predicatops -> Stratigraphic predication designed for hydrocarbon
  • stratal-geometries -> Predicting Stratigraphic Geometries from Subsurface Well Logs

Structural

Simulation

  • GebPy -> generation of geological data for rocks and minerals
  • OpenGeoSys -> development of numerical methods for the simulation of thermo-hydro-mechanical-chemical (THMC) processes in porous and fractured media
  • Stratigraphics.jl -> Creating 3D stratigraphy from 2D geostatistical processes

Geodynamics

  • Badlands -> Basin and Landscape Dynamics
  • CitcomS -> finite element code designed to solve compressible thermochemical convection problems relevant to Earth's mantle.
  • LaMEM -> simulate various thermo-mechanical geodynamical processes such as mantle-lithosphere interaction
  • PTatin3D -> studying long time-scale processes relevant to geodynamics [original motivation :toolkit capable of studying high-resolution, three-dimensional models of lithospheric deformation]
  • underworld -> Finite element modelling of geodynamics

Geophysics

Foundation Models

Australia

Regolith Depth

AEM Interpolation

Electromagnetics

Inversion

Euler deconvolution

Gravity

Magnetics

Seismic

  • StorSeismic -> An approach to pre-train a neural network to store seismic data features
  • PINNtomo -> Seismic tomography using physics-informed neural networks

Seismology

  • obspy -> framework for processing seismological

Petrophysics

Tectonics

Geochemistry

Kriging

Natural Language Processing

Word Embeddings

Named Entity Recognition

Ontology

Large Language Models

Chatbots

  • GeoGPT -> Deep Time Digital Earth Research Group from China project

Remote Sensing

Processing

  • ASTER Conversion -> Conversion from ASTER hd5 to geotiff NASA github
  • HLS Data Resources -> Harmonized Landsat Sentinel wrangling
  • sarsen -> xarray based SAR image processing and correction
  • openEO -> openEO develops an open API to connect R, Python, JavaScript and other clients to EO cloud back-ends

Spectral Unmixing

Hyperspectral

Visualisation

Texture

Simulation

Geometry

  • Deep Angle -> Fast calculation of contact angles in tomography images using deep learning

Other

Platforms

Guides

Data Quality

Machine Learning

  • Dask-ml -> Distributed versions of some common ML algorithms
  • geospatial-rf -> Functions and wrappers to assist with random forest applications in a spatial context
  • Geospatial-ml -> Install multiple common packages at once

Latent Space

  • Nested Fusion
    • paper -> Nested Fusion: Dimensionality Reduction and Latent Structure Analysis of Multi-Scale Nested Data for M2020 PIXL RGBU and XRF Data

Metrics

  • scores -> Verifying and evaluating models and predictions with xarray

Probabilistic

Clustering

Self Organising Maps

  • GisSOM -> Geospatial centred Self Organising Maps from Finland Geological Survey
  • SimpSOM -> Self Organising Maps

Other

Bayesian

  • Bayseg -> Spatial segmentation

Explainability

Deep Learning

Data

Explainability

Self-supervised learning

Hyperparameters

Coding Environments

Community

Cloud Providers

AWS

Batch

  • Shepard -> Automated cloud formation setup of AWS Batch Pipelines: this is great

Packages

General

Overviews

Domains

Web Services

If listed it is assumed they are generally data, if just pictures like WMS it will say so.

World

Australia

Geology

Geophysics

Other

New South Wales

Queensland

South Australia

Northern Territory

  • NTGS -> Northern Territory Geological Survey

Tasmania

Victoria

Western Australia

New Zealand

  • GNS -> List of web services

South America

Brazil

Peru

Mexico

Argentina

Colombia

Uruguay

Other

Europe

EGDI -> EGDI Minerals

Sweden

Finland

Denmark

  • deus -> Greenland WMS/WFS

Portugal

Spain

Ukraine

Ireland

Britain

Germany

Czech Republic

Slovakia

Hungary

Romania

Poland

North America

Canada

USA

Asia

Africa

General

Other

APIs

Data Portals

World

  • Earth Model Collaboration -> access to various Earth models, visualization tools for model preview, facilities to extract model data/metadata and access to the contributed processing software and scripts.

Australia

Geoscience Australia

CSIRO

AuScope

TERN

Bureau of Meteorology

Foundational Spatial Data

South Australia

Northern Territory

Queensland

Western Australia

NSW

  • MINVIEW -> New South Wales Geological Survey
  • DiGS -> Publications and Geotechnical collections

Tasmania

Victoria

New Zealand

South America

Brazil

  • CPRM -> Brazil Geological Survey
  • Downloads -> Brazil Geological Survey Downloads
  • Rigeo -> Institutional Repository of Geosciences

Peru

Mexico

Argentina

Colombia

Uruguay

Chile

Europe

Denmark

Finland

Sweden

  • SGU -> Swedish Geological Survey

Spain

  • IGME -> Spanish Geological Survey

Portugal

Ireland

  • GSI -> Geological Survey of Ireland
  • GSI - Map viewer
  • Goldmine -> Map and document search
  • data.gov.ie -> National portal view
  • isde -> Irish Spatial Data Exchange

Norway

Britain

Ukraine

Russia

Germany

France

Croatia

Czech Republic

  • GS -> Czech Geological Survey

Slovenia

Slovakia

Hungary

Romania

Poland

United Kingdom

North America

Canada

USA

Africa

Asia

China

India

  • Bhukosh -> India Geological Survey
  • Note Rajasthan geology doesn't work except piecemeal which is painful - if you want it, let me know

Saudi Arabia

Other

Geology

Iran

Geology

General

Reports

Australia

Canada

USA

Other

Tools

GIS

  • QGIS -> GIS Data Visualisation and Analysis Open Source desktop application, has some ML tools : Indispensible for some quick and easy viewing
  • GRASS
  • saga -> mirror of sourceforge

3D

Geospatial General

Vector Data

Python

R

  • SF
  • terra -> terra provides methods to manipulate geographic (spatial) data in "raster" and "vector" form.

Raster Data

C

Julia

  • Rasters.jl -> reading and writing common raster data types

Python

  • Rasterio -> python base library for raster data handling
  • georeader -> process raster data from different satellite missions
  • Rasterstats -> summarising geospatial raster datasets based on vector geometries
  • Xarray -> Multidimensional Labelled array handling and analysis
    • Rioxarray -> Fabulous high level api for xarray handling of raster data
    • Geocube -> Rasterisation of vector data api
    • ODC-GEO -> Tools for remote sensing based raster handling with many extremely handy tools like colorisation, grid workflows
    • COG Validator -> checking format of cloud optimised geotiffs
    • serverless-datacube-demo -> xarray via lithops / Coiled / Modal
    • Xarray Spatial -> Statistical analysis of raster data such as classification like natural breaks
    • xdggs -> Other types of grids
    • xgcm -> Histograms with labels
    • xrft -> Xarray based Fourier Transforms
    • xvec -> Vector data cubes for Xarray
    • xarray-einstats -> Stats, linear algebra and einops for xarray

R

  • Raster -> R library
  • terra -> provides methods to manipulate geographic (spatial) data in "raster" and "vector" form.
  • stars -> spatiotemporal Arrays: Raster and Vector Datacubes
  • exactextracr -> raster zonal statistics for R

Benchmarks

Gui

  • Whitebox Tools -> python api, gui, etc. have used for topographical wetness index calculation

Data Collection

  • PiAutoStage -> 'An Open-Source 3D Printed Tool for the Automatic Collection of High-Resolution Microscope Imagery;' designed for mineral samples.

Data Conversion

Geochemistry

Geostatistics

Geochronology

Geology

Geophysics

Electromagnetic

Gravity and Magnetics

Seismic

Magnetotellurics

Gridding

Inversion

Geochemistry

Drilling

  • dh2loop -> Drilling Interval assistance
  • drilldown -> Drilling visualisation in notebooks via geoh5py -> note desurveying
  • PyGSLib -> Downhole surveying and interval normalising
  • pyborehole -> Processing and visualizing borehole data
  • dhcomp -> composites geophysical data to a set of intervals

Remote Sensing

Serverless

  • Kerchunk -> Serverless access to cloud based data via Zarr
  • Kerchunk geoh5 -> Access to Geoscient Analyst/geoh5 projects serverlessly via kerchunk
  • icehunk -> Transactional storage engine for tensor / ND-array data designed for use on cloud object storage.

Stac catalogues

Statistics

Visualisation

Mineral Potential

Mining Economics

  • Bluecap -> Framework from Monash University for assessing mine viability
  • Zipfs Law -> Curve fitting the distribution of Mineral Depositions
  • PyASX -> ASX Data Feed scraping
  • Metal Price API -> Containerised Microservice

Visualisation

Colormaps

Geospatial

Technology Stacks

C

  • GDAL -> Absolutely crucial data transformation and analysis framework
    • Tools -> Note has many command line tools that are very useful as well

Julia

Python - PyData

Rust - GeoRust

  • GeoRust -> Collection of geospatial utilities in rust

Databases

Data Science

Probability

  • distfit -> Probability density fitting

Science

Docker

Ontologies

Books

Python

Other

Other

  • GXPy -> Geosoft Python API
  • EarthArxiv -> Download papers from the preprint archive
  • Essoar -> Preprint paper archive

Datasets

World

Geology

  • Bedrock -> Generalised geology of the world
  • GLIM -> Global lithology map
  • Paleogeology An Atlas of Phanerozoic Paleogeographic Maps
  • Sedimentary Layers -> Global 1-km Gridded Thickness of Soil, Regolith, and Sedimentary Deposit Layers
  • World Stress Map -> Global compilation of information on the crustal present-day stress field
  • GMBA -> Global mountain inventory

Geophysics

Gravity

Magnetics

  • EAMG2V3 _> Earth Magnetic Anomaly Grid
  • WDMAM -> World Digital Magnetic Anomaly Map

Magnetotellurics

  • EMC -> global 3D inverse model of electrical conductivity

Seismic

Thermal

General

Australia

Geochemistry

Geology

Geophysics

  • Gravity -> 2019 Australian National Gravity Grids

Magnetics

  • TMI -> Magnetic Anomaly Map of Australia, Seventh Edition, 2019 TMI
  • 40m -> 40m version
  • VRTP -> Total Magnetic Intensity (TMI) Grid of Australia with Variable Reduction to Pole (VRTP) 2019
  • 1VD -> Total Magnetic Intensity Grid of Australia 2019 - First Vertical Derivative (1VD)

Radiometrics

  • Radiometrics -> Complete Radiometric Grid of Australia (Radmap) v4 2019 with modelled infill
  • K -> Radiometric Grid of Australia (Radmap) v4 2019 filtered pct potassium grid
  • U -> Radiometric Grid of Australia (Radmap) v4 2019 filtered ppm uranium
  • Th -> Radiometric Grid of Australia (Radmap) v4 2019 filtered ppm thorium
  • Th/K -> Radiometric Grid of Australia (Radmap) v4 2019 ratio thorium over potassium
  • U/K -> Radiometric Grid of Australia (Radmap) v4 2019 ratio uranium over potassium
  • U/Th -> Radiometric Grid of Australia (Radmap) v4 2019 ratio uranium over thorium
  • U squared/Th -> Radiometric Grid of Australia (Radmap) v4 2019 ratio uranium squared over thorium
  • Dose Rate-> Radiometric Grid of Australia (Radmap) v4 2019 filtered terrestrial dose rate
  • Ternary Picture -> Radiometric grid of Australia (Radmap) v4 2019 - Ternary image (K, Th, U)

AusAEM

  • AusAEM 1 -> AusAEM Year 1 NT/QLD Airborne Electromagnetic Survey; GA Layered Earth Inversion Products
  • AusAEM 1 -> AusAEM Year 1 NT/QLD: TEMPEST® airborne electromagnetic data and Em Flow® conductivity estimates
  • AusAEM 1 -> AusAEM1 Interpretation Data Package
  • AusAEM 2 -> AusAEM 02 WA/NT 2019-20 Airborne Electromagnetic Survey
  • AusAEM–WA -> AusAEM–WA, Murchison Airborne Electromagnetic Survey Blocks
  • AusAEM–WA -> AusAEM-WA, Southwest-Albany Airborne Electromagnetic Survey Blocks
  • AusAEM–WA -> AusAEM WA 2020-21, Eastern Goldfields & East Yilgarn Airborne
  • AusAEM–WA -> AusAEM (WA) 2020-21, Earaheedy & Desert Strip
  • AusAEM ERC -> AusAEM Eastern Resources Corridor
  • AusAEM WRC -> AusAEM Western Resources Corridor
  • interp overview
  • National surface and near-surface conductivity grids -> National ML interpolation for AusEM in similar fashion to Northern Australia

AusLAMP

Moho

Mineral Deposits

Mineral Potential

Mine Waste

Native Title

Remote Sensing

Structure

Velocity

  • AU Tomo -> Next-generation velocity model of the Australian crust from synchronous and asynchronous ambient noise imaging

Topography

Northern

South Australia

Geology

Geophysics

Gawler
  • Gawler MPP -> Gawler Mineral Promotion Project - Data

Queensland

Cloncurry

  • Toolkit -> Multielement toolkit and laboratory

Northern Territory

  • Arunta IOCG -> Iron oxide-copper-gold potential of the southern Arunta Region
  • South Uranium -> Southern Northern Territory uranium and geothermal energy systems assessment digil data package
  • Tennant Creek -> Conductivity Model Derived from Magnetotelluric Data in the East Tennant Region, Northern Territory

New South Wales

Geology

  • Seamless Geology -> NSW Seamless Geology Data Package (older version also on this page)

Mineral Potential Data Packages

Western Australia

Geochemistry

Geology

Mineral Potential

Prospectivity

  • Capricorn-> Prospectivity analysis using a mineral systems approach - Capricorn case study project
  • King Leopold -> Mineral prospectivity of the King Leopold Orogen and Lennard Shelf: analysis of potential field data in the west Kimberley region
  • Yilgarn Gold
  • Yilgarn 2 -> Predictive mineral discovery in the eastern Yilgarn Craton: an example of district-scale targeting of an orogenic gold mineral system
  • [Shop note] -> WA has a few prospectivity packages available to purchase on USB drive for 50-60AU type prices - see in geospaital maps section

Tasmania

Geology

Victoria

New Zealand

North Americia

Canada

Geology

  • Map
  • Geology -> Updated Bedrock geology map
  • Geology -> Bedrock geology compilation and regional synthesis of south Rae and parts of Hearne domains, Churchill Province, Northwest Territories, Saskatchewan, Nunavut, Manitoba and Alberta
  • Moho -> National database of Moho depth estimates estimates from seismic refraction and teleseismic surveys

Geophysics

  • Dap Search -> Geoportal search - note annoyingly these are in Geosoft grids - see elsewere for conversion possibilties
  • [Gravity, Magnetics, Radiometrics] -> Mostly country scale

Europe

Finland

  • FODD -> Fennoscandian Mineral Deposits

Ireland

  • MPM -> Mineral Potentinal Mapping project

Papers with Code

NLP

Geochemistry

Geology

Mineral

Papers with Features Data

  • These you can reproduce the output geospatially from the data given.

Mineral Prospectivity

England

Geochemistry

Geology

Geophysics

Geospatial Output - No Code

Journals

Papers

  • Generally Not ML, or no Code/Data and sometimes no availability at all
  • Eventually will separate out into things that have data packages or not like NSW Zone studies.
  • However, if interested in an area you can often georeference a picture if nothing else as a rough guide.
  • Generally these are not reproducible - a few like the NSW prospectivity zone studies and NWQMP are with some work.
  • The occasional paper in this section may be listed above

New to File

General

Mineral Prospectivity

Australia

Argentina

Brazil

Fuzzy

Canada

Central Africa

Chile

China

Egypt

England

Eritrea

Finland

Finland

Ghana

Greenland

India

Indonesia

Iran

Ireland

India

Korea

Norway

South Korea

Phillipines

Russia

South Africa

Spain

Sudan

Sweden

Tanzania

Uganda

United Kingdom

USA

Zambia

Zimbabwe

GENERAL PAPERS

Overviews

Deposits

ESG

Geochemistry

Causal Discovery and Deep Learning Algorithms for Detecting Geochemical Patterns Associated with Gold-Polymetallic Mineralization: A Case Study of the Edongnan Region

Apatite

Geology

Alteration

Depth

Drill Core

General

Geochronology

Geomorphology

Lithology

Mineralogy

Stratigraphy

Structure

Tectonics

Geophysics

Foundation

General

Potential Fields

EM

ERT

Gravity

Hyperspectral

Joint Inversion

Magnetics

Magnetotellurics

Passive Seismic

Seismic

Surface Resistivity

Uncertainty

Geothermal

Maps

Mineral

NLP

Petrography

Last edited: 29/09/2020 The below are a collection of works from when I was doing a review

Public Mineral Prospectivity Mapping

Overview

Geochemistry

Fuzzy

Uncertainty

Geospatial Maps

Australia

South Australia

NT

WA

Brazil

Australia

SA

WA

NT

NSW

Brazil

Carajas

Gurupi

Australia

South Australia

Queensland

New South Wales

Tasmania

Victoria

Western Australia

Endowment Modelling

World Models

Financial Forecasting

Agent based Modelling

Spectral Unmixing

  • Overviews and examples, with some focus on neural network approaches.

Neural Networks

General

Africa

Brazil

China

Greenland

India

Iran

Peru

Spain

Other

NLP

LLM

General-Interest

Deep Learning