Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Introduce a Parser module stub #146

Draft
wants to merge 19 commits into
base: master
Choose a base branch
from
Draft

Introduce a Parser module stub #146

Changes from 5 commits
Commits
Show all changes
19 commits
Select commit Hold shift + click to select a range
2426b8d
Introduce a Parser module stub
Glutexo Aug 26, 2022
5a06169
Merge branch 'master' into parser
Glutexo Aug 29, 2022
a14fa18
Merge branch 'master' into parser
nappex Apr 7, 2023
b1878f3
Merge branch 'naming-directory-structure' into parser
nappex Apr 7, 2023
10841b1
Move parser to a new file because of new rules set for naming structure
nappex Apr 7, 2023
5ae6f14
Merge branch 'master' into parser
Glutexo May 20, 2023
65ddbfb
List files with .raw extension
Glutexo May 20, 2023
4b700f6
Print every line, don’t join
Glutexo May 20, 2023
8cf202e
Extract file listing to methods
Glutexo May 20, 2023
7223f36
Fix indentation
Glutexo Oct 21, 2023
8d2185b
Merge branch 'master' into parser
Glutexo May 10, 2024
69a1305
Create a parser test stub
Glutexo May 20, 2024
8895452
Add main result test
Glutexo May 25, 2024
c20c6d2
Test is_downloaded
Glutexo May 25, 2024
c73275f
First test of list_downloaded
Glutexo May 25, 2024
bd812f8
Fix comparison
Glutexo Jun 2, 2024
452430d
Add a non-empty list_downloaded test
Glutexo Jun 2, 2024
35cc96a
Compare ls output MapSets instead of Lists
Glutexo Jun 2, 2024
b61242b
Test list_downloaded
Glutexo Jun 2, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 14 additions & 0 deletions lib/onigumo/parser.ex
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,14 @@
defmodule Onigumo.Parser do
@moduledoc """
Web scraper
"""

def main(root_path) do
root_path
|> File.ls!()
Glutexo marked this conversation as resolved.
Show resolved Hide resolved
|> Enum.reject(&File.dir?(&1))
|> Enum.reject(&String.contains?(&1, "."))
Glutexo marked this conversation as resolved.
Show resolved Hide resolved
|> Enum.join("\n")
Copy link
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

this line seems to be unnecessary, we can collect filename one by one, we dont have to print all filenames as one output.

|> IO.puts()
end
end