Skip to content

ci: improved testing by auto-parsing sources#1632

Open
avik-pal wants to merge 2 commits into
mainfrom
ap/improved_testing_ci
Open

ci: improved testing by auto-parsing sources#1632
avik-pal wants to merge 2 commits into
mainfrom
ap/improved_testing_ci

Conversation

@avik-pal

Copy link
Copy Markdown
Member

No description provided.

@gemini-code-assist

Copy link
Copy Markdown

Note

Gemini is unable to generate a summary for this pull request due to the file types involved not being currently supported.

@codecov

codecov Bot commented Jan 16, 2026

Copy link
Copy Markdown

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 70.88%. Comparing base (4f3d601) to head (5441b55).
⚠️ Report is 1 commits behind head on main.

❗ There is a different number of reports uploaded between BASE (4f3d601) and HEAD (5441b55). Click for more details.

HEAD has 15 uploads less than BASE
Flag BASE (4f3d601) HEAD (5441b55)
47 32
Additional details and impacted files
@@            Coverage Diff             @@
##             main    #1632      +/-   ##
==========================================
- Coverage   80.68%   70.88%   -9.80%     
==========================================
  Files         173      172       -1     
  Lines        7201     7193       -8     
==========================================
- Hits         5810     5099     -711     
- Misses       1391     2094     +703     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@avik-pal avik-pal force-pushed the ap/improved_testing_ci branch 3 times, most recently from 5441b55 to d0bee95 Compare January 16, 2026 18:36
@github-actions

github-actions Bot commented Jan 16, 2026

Copy link
Copy Markdown
Contributor

Benchmark Results (Julia v1.11)

Time benchmarks
main 34e1e76... main / 34e1e76...
basics/MHA 5.75 ± 2.9 μs 5.72 ± 2.9 μs 1.01 ± 0.71
basics/MHA (first run) 4.47 ± 0.52 μs 4.36 ± 0.53 μs 1.03 ± 0.17
basics/MHA reactant 0.0601 ± 0.0038 ms 0.0632 ± 0.0055 ms 0.951 ± 0.1
basics/MHA reactant (comp + run) 0.166 ± 0.0033 s 0.165 ± 0.0026 s 1 ± 0.025
basics/conv 10.8 ± 11 μs 10.9 ± 11 μs 0.993 ± 1.4
basics/conv (first run) 10.3 ± 0.57 μs 10.2 ± 0.57 μs 1 ± 0.079
basics/conv reactant 0.0483 ± 0.0017 ms 0.0507 ± 0.0028 ms 0.953 ± 0.062
basics/conv reactant (comp + run) 0.124 ± 0.0027 s 0.121 ± 0.005 s 1.02 ± 0.048
basics/dense 0.19 ± 0.001 μs 0.18 ± 0.001 μs 1.06 ± 0.0081
basics/dense (first run) 0.2 ± 0.01 μs 0.2 ± 0.001 μs 1 ± 0.05
basics/dense reactant 0.0451 ± 0.0018 ms 0.0461 ± 0.0028 ms 0.977 ± 0.07
basics/dense reactant (comp + run) 0.104 ± 0.0026 s 0.104 ± 0.0014 s 1 ± 0.028
time_to_load 0.871 ± 0.004 s 0.869 ± 0.0016 s 1 ± 0.005
Memory benchmarks
main 34e1e76... main / 34e1e76...
basics/MHA 0.087 k allocs: 6.05 kB 0.087 k allocs: 6.05 kB 1
basics/MHA (first run) 0.087 k allocs: 6.05 kB 0.087 k allocs: 6.05 kB 1
basics/MHA reactant 19 allocs: 0.578 kB 19 allocs: 0.578 kB 1
basics/MHA reactant (comp + run) 18.2 k allocs: 1.71 MB 18.2 k allocs: 1.71 MB 1
basics/conv 0.038 k allocs: 5.12 kB 0.038 k allocs: 5.12 kB 1
basics/conv (first run) 0.038 k allocs: 5.12 kB 0.038 k allocs: 5.12 kB 1
basics/conv reactant 15 allocs: 0.438 kB 15 allocs: 0.438 kB 1
basics/conv reactant (comp + run) 6.4 k allocs: 1.16 MB 6.4 k allocs: 1.16 MB 1
basics/dense 2 allocs: 0.109 kB 2 allocs: 0.109 kB 1
basics/dense (first run) 2 allocs: 0.109 kB 2 allocs: 0.109 kB 1
basics/dense reactant 15 allocs: 0.422 kB 15 allocs: 0.422 kB 1
basics/dense reactant (comp + run) 6.05 k allocs: 1.14 MB 6.05 k allocs: 1.14 MB 1
time_to_load 0.159 k allocs: 11.2 kB 0.159 k allocs: 11.2 kB 1

@avik-pal avik-pal force-pushed the ap/improved_testing_ci branch from d0bee95 to d26e5ec Compare January 16, 2026 19:18
@avik-pal avik-pal force-pushed the ap/improved_testing_ci branch from d26e5ec to 34e1e76 Compare January 16, 2026 19:26
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant