Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dysgu dev #115

Merged
merged 33 commits into from
Nov 20, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
33 commits
Select commit Hold shift + click to select a range
68b8452
dysgu_dev <- master (#108)
kcleal Sep 12, 2024
1b99e20
Better recall+precision for long-reads. Improved merging pipeline. Fa…
kcleal Oct 23, 2024
d2fe1e6
Fixed issues with overriding presets. --mode option updated # [skip ci]
kcleal Oct 24, 2024
4e20451
Fixed issues with overriding presets. --mode option updated to suppor…
kcleal Oct 24, 2024
2a0b2c3
Merge branch 'master' into dysgu_dev
kcleal Oct 24, 2024
21ea3b3
Fixed CLI issues for tests # [skip ci]
kcleal Oct 24, 2024
96dcd00
Merge remote-tracking branch 'origin/dysgu_dev' into dysgu_dev
kcleal Oct 24, 2024
a15ffaf
Fixed API issue
kcleal Oct 24, 2024
2691164
v1.7.0
kcleal Oct 24, 2024
7d06045
added deprecated warning for mode
kcleal Oct 24, 2024
b82a0c0
Merge branch 'master' into dysgu_dev
kcleal Oct 24, 2024
8081665
Added filter for high divergence reads (long-reads only) # [skip ci]
kcleal Oct 25, 2024
ef651f4
Better read merging for long reads. New clustering methods for long r…
kcleal Nov 15, 2024
0e3e65f
Update main.yml
kcleal Nov 16, 2024
5b2d503
Update main.yml
kcleal Nov 16, 2024
fcf6c04
Update osx-deps
kcleal Nov 16, 2024
15be213
Update main.yml macos11
kcleal Nov 16, 2024
c44b3c6
Update main.yml
kcleal Nov 16, 2024
9299731
Update main.yml
kcleal Nov 18, 2024
4cd21d1
Update main.yml
kcleal Nov 18, 2024
53b5da6
Update osx-deps
kcleal Nov 18, 2024
297bd40
Update osx-deps
kcleal Nov 18, 2024
835db2c
Update osx-deps
kcleal Nov 18, 2024
6c45165
Update osx-deps
kcleal Nov 18, 2024
46a0613
Update main.yml
kcleal Nov 18, 2024
cbd426a
Update osx-deps
kcleal Nov 18, 2024
6b6e781
Update main.yml
kcleal Nov 18, 2024
b475e36
Updated workflow
kcleal Nov 19, 2024
dc82d07
Updated workflow
kcleal Nov 19, 2024
c800806
Updated workflow
kcleal Nov 19, 2024
654245f
Update main.yml
kcleal Nov 20, 2024
2af3a89
Updated workflow
kcleal Nov 20, 2024
636883d
Merge branch 'master' into dysgu_dev
kcleal Nov 20, 2024
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
21 changes: 14 additions & 7 deletions .github/workflows/main.yml
Original file line number Diff line number Diff line change
Expand Up @@ -10,18 +10,22 @@ jobs:
runs-on: ${{ matrix.os }}
strategy:
matrix:
os: [ubuntu-20.04, macOS-13]
os: [ubuntu-20.04, macOS-14]
#os: [ubuntu-latest, macOS-11]

steps:
- uses: actions/checkout@v4
- name: Set correct paths for Homebrew on macOS
if: matrix.os == 'macOS-13'
if: matrix.os == 'macOS-14'
run: |
BREW_PREFIX=$(brew --prefix)
export BREW_PREFIX="$(brew --prefix)"
export PREFIX="$(brew --prefix)"
export PATH="$BREW_PREFIX/bin:$PATH"
export LIBRARY_PATH="$BREW_PREFIX/lib:$LIBRARY_PATH"
export PKG_CONFIG_PATH="$BREW_PREFIX/lib/pkgconfig:$PKG_CONFIG_PATH"
export MACOSX_DEPLOYMENT_TARGET=14.0
echo "MACOSX_DEPLOYMENT_TARGET=14.0" >> $GITHUB_ENV
brew install libomp
- name: Install project dependencies
run: which python; python -m pip install -r requirements.txt
- name: Build wheels
Expand All @@ -32,16 +36,19 @@ jobs:
CIBW_ARCHS_MACOS: "x86_64 arm64"
CIBW_ARCHS_LINUX: "auto"
CIBW_BEFORE_ALL_MACOS: |
bash ci/osx-deps
CIBW_BEFORE_ALL_LINUX: bash ci/manylinux-deps
sudo bash ci/osx-deps
CIBW_BEFORE_ALL_LINUX: |
bash ci/manylinux-deps
CIBW_BEFORE_BUILD_MACOS: |
ln -s /Library/Frameworks/Python.framework/Versions/3.11/include/python3.11/cpython/longintrepr.h /Library/Frameworks/Python.framework/Versions/3.11/include/python3.11
which python3
python3 -m pip install -r requirements.txt
CIBW_BEFORE_BUILD_LINUX: pip install -r requirements.txt
CIBW_REPAIR_WHEEL_COMMAND_MACOS: delocate-wheel --require-archs x86_64 -w {dest_dir} -v {wheel} --require-target-macos-version 13.0
CIBW_REPAIR_WHEEL_COMMAND_MACOS: |
delocate-wheel -w {dest_dir} -v {wheel} --require-target-macos-version 14.0
CIBW_TEST_SKIP: "*-macosx_arm64"
CIBW_TEST_REQUIRES: cython click>=8.0 numpy scipy pandas pysam>=0.22.0 networkx>=2.4 scikit-learn>=0.22 sortedcontainers lightgbm
CIBW_TEST_REQUIRES: |
cython click>=8.0 numpy scipy pandas pysam>=0.22.0 networkx>=2.4 scikit-learn>=0.22 sortedcontainers lightgbm
CIBW_TEST_COMMAND: dysgu test --verbose

- uses: actions/upload-artifact@v4
Expand Down
31 changes: 24 additions & 7 deletions ci/osx-deps
Original file line number Diff line number Diff line change
@@ -1,15 +1,32 @@
#!/bin/bash

git clone --depth 1 https://github.com/ebiggers/libdeflate.git && \
cd libdeflate && CFLAGS+=' -fPIC -O3 ' cmake -B build && CFLAGS+=' -fPIC -O3 ' cmake --build build && \
cp build/libdeflate.a /usr/local/lib && cp libdeflate.h /usr/local/include && cd ../

BREW_PREFIX="$(brew --prefix)"

export MACOSX_DEPLOYMENT_TARGET=14.0
export CFLAGS="${CFLAGS} -mmacosx-version-min=14.0"
export CPPFLAGS="${CXXFLAGS} -mmacosx-version-min=14.0 -I${BREW_PREFIX}/include "
export LDFLAGS="${LDFLAGS} -mmacosx-version-min=14.0 -L${BREW_PREFIX}/lib"

git clone --depth 1 https://github.com/ebiggers/libdeflate.git
cd libdeflate
CFLAGS+=" -fPIC -O3 " cmake -B build
CFLAGS+=" -fPIC -O3 " cmake --build build
cp build/libdeflate.a ${BREW_PREFIX}/lib
cp libdeflate.h ${BREW_PREFIX}/include
cd ../

cd ./dysgu
wget -O htslib.tar.bz2 https://github.com/samtools/htslib/releases/download/1.17/htslib-1.17.tar.bz2
wget -O htslib.tar.bz2 https://github.com/samtools/htslib/releases/download/1.21/htslib-1.21.tar.bz2
ls -lh
tar -xvf htslib.tar.bz2
mv htslib-1.17 htslib && rm htslib.tar.bz2
mv htslib-1.21 htslib && rm htslib.tar.bz2
cd htslib

./configure --enable-libcurl --enable-s3 --enable-lzma --enable-bz2 --with-libdeflate
make && make install
./configure \
--enable-libcurl \
--enable-s3 \
--enable-lzma \
--enable-bz2 \
--with-libdeflate
sudo make && make install
Loading