Skip to content

Assign checkers with cost/import-aware algorithm - #4313

Draft
jakebailey wants to merge 11 commits into
mainfrom
jabaile/checker-association-only
Draft

Assign checkers with cost/import-aware algorithm#4313
jakebailey wants to merge 11 commits into
mainfrom
jabaile/checker-association-only

Conversation

@jakebailey

@jakebailey jakebailey commented Jun 14, 2026 •
edited
Loading

Copy link
Copy Markdown
Member

WIP

@jakebailey
Assign checkers with balanced import-graph locality
2d60e09 
The checker pool previously assigned files to checkers with simple
round-robin striping. That balances file count, but adjacent files and
resolved import neighbors often share generic instantiations and
symbol/type links, so the same work is repeated across checker-local
caches.

Start with deterministic weighted blocks to preserve program-order
locality, then run a small FM-style graph refinement over the resolved
import graph. A file can move toward the checker containing more of its
import neighbors only when the target remains under a strict static cost
cap, keeping parallel work balanced.

Perf on ~/work/vscode/src with tsgo -p . --noEmit
--extendedDiagnostics, 5-run average versus main:
Memory allocs 25,210,536 -> 24,028,267 (-1,182,268, -4.7%).
Memory used 4,473,325K -> 4,242,826K (-230,500K, -5.2%).
Check time 4.741s -> 4.294s (-0.447s, -9.4%).
Total time 5.370s -> 4.969s (-0.401s, -7.5%).
Copilot AI review requested due to automatic review settings June 14, 2026 00:59
@jakebailey

jakebailey commented Jun 14, 2026

Copy link
Copy Markdown
Member Author

@typescript-bot perf test this faster

@typescript-automation

typescript-automation Bot commented Jun 14, 2026 •
edited
Loading

Copy link
Copy Markdown

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
perf test this faster ✅ Started 👀 Results

Copilot AI reviewed Jun 14, 2026
View reviewed changes

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the compiler’s checker pooling strategy to assign source files to checkers using a weight-balanced, import-graph-aware affinity algorithm, aiming to improve type-check performance by keeping related files on the same checker while maintaining load balance.

Changes:

  • Added a file-to-checker association algorithm that assigns contiguous file blocks by estimated “work” (text + node + symbol counts).
  • Refined those associations using an undirected import adjacency graph, moving files to increase import-neighbor locality while respecting a balance cap.
  • Added unit tests covering the block sizing, initial weight-based association, and graph refinement behavior.

Reviewed changes

Copilot reviewed 2 out of 2 changed files in this pull request and generated 1 comment.

File Description
internal/compiler/checkerpool.go Implements weight-based checker associations and import-graph refinement, and uses the resulting mapping when creating fileAssociations.
internal/compiler/checkerpool_test.go Adds unit tests for the new association/refinement helpers.

Comment thread internal/compiler/checkerpool_test.go Outdated
@typescript-automation

typescript-automation Bot commented Jun 14, 2026

Copy link
Copy Markdown

@jakebailey
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 4 4 ~ ~ ~ p=1.000 n=6
Symbols 81,764 (± 0.04%) 81,796 (± 0.03%) ~ 81,766 81,842 p=0.173 n=6
Types 98,821 98,486 -335 (- 0.34%) ~ ~ p=0.001 n=6
Memory Used 179,747k (± 0.65%) 180,408k (± 0.60%) ~ 178,782k 181,326k p=0.230 n=6
Memory Allocs 1,577,199 (± 0.01%) 1,575,786 (± 0.02%) -1,412 (- 0.09%) 1,575,405 1,576,107 p=0.005 n=6
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Parse Time 0.062s (± 6.05%) 0.063s (±11.35%) ~ 0.054s 0.070s p=0.872 n=6
Bind Time 0.018s (±26.40%) 0.016s (± 9.60%) ~ 0.013s 0.017s p=0.324 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.854s (± 1.77%) 0.808s (± 1.22%) 🟩-0.046s (- 5.43%) 0.798s 0.826s p=0.005 n=6
Total Time 0.935s (± 1.61%) 0.888s (± 1.79%) 🟩-0.048s (- 5.10%) 0.868s 0.912s p=0.005 n=6
angular-1 - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 876,293 (± 0.09%) 831,207 (± 0.09%) 🟩-45,086 (- 5.15%) 830,639 832,204 p=0.005 n=6
Types 263,750 (± 0.00%) 236,508 (± 0.00%) 🟩-27,242 (-10.33%) 236,507 236,509 p=0.004 n=6
Memory Used 829,834k (± 0.05%) 807,983k (± 0.10%) -21,851k (- 2.63%) 806,713k 809,103k p=0.005 n=6
Memory Allocs 6,920,410 (± 0.52%) 6,778,086 (± 0.63%) -142,324 (- 2.06%) 6,741,865 6,840,099 p=0.005 n=6
Config Time 0.017s (± 2.98%) 0.017s ~ ~ ~ p=0.174 n=6
Parse Time 0.251s (± 5.98%) 0.251s (± 2.42%) ~ 0.244s 0.259s p=0.936 n=6
Bind Time 0.049s (±37.70%) 0.046s (±26.66%) ~ 0.037s 0.070s p=0.935 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 1.883s (± 1.23%) 1.862s (± 1.42%) ~ 1.828s 1.896s p=0.149 n=6
Total Time 2.215s (± 0.83%) 2.194s (± 1.02%) ~ 2.169s 2.232s p=0.078 n=6
mui-docs - native
Errors 11,244 (± 0.02%) 11,243 (± 0.04%) ~ 11,234 11,246 p=0.870 n=6
Symbols 4,209,758 4,031,231 🟩-178,527 (- 4.24%) ~ ~ p=0.001 n=6
Types 1,532,163 1,410,431 🟩-121,732 (- 7.95%) ~ ~ p=0.001 n=6
Memory Used 4,962,536k (± 0.03%) 4,767,515k (± 0.06%) 🟩-195,021k (- 3.93%) 4,763,359k 4,770,953k p=0.005 n=6
Memory Allocs 82,682,736 (±14.95%) 83,469,664 (±21.61%) ~ 71,019,016 116,405,449 p=0.936 n=6
Config Time 0.016s 0.016s (± 2.52%) ~ 0.016s 0.017s p=0.405 n=6
Parse Time 1.052s (±20.73%) 1.103s (±26.99%) ~ 0.911s 1.671s p=0.575 n=6
Bind Time 0.002s 0.002s ~ ~ ~ p=1.000 n=6
Check Time 17.114s (± 0.57%) 16.623s (± 0.27%) -0.491s (- 2.87%) 16.559s 16.671s p=0.005 n=6
Emit Time 0.455s (± 4.58%) 0.469s (± 3.15%) ~ 0.439s 0.478s p=0.170 n=6
Total Time 19.341s (± 0.90%) 18.892s (± 1.79%) -0.449s (- 2.32%) 18.659s 19.565s p=0.045 n=6
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,394,138 1,360,690 -33,448 (- 2.40%) ~ ~ p=0.001 n=6
Types 442,153 414,656 🟩-27,497 (- 6.22%) ~ ~ p=0.001 n=6
Memory Used 1,647,147k (± 0.13%) 1,603,052k (± 0.28%) -44,095k (- 2.68%) 1,597,847k 1,609,999k p=0.005 n=6
Memory Allocs 55,621,934 (± 0.07%) 53,159,300 (± 0.08%) 🟩-2,462,634 (- 4.43%) 53,105,637 53,237,233 p=0.005 n=6
Config Time 0.015s (±41.91%) 0.014s (±68.27%) ~ 0.005s 0.026s p=0.810 n=6
Parse Time 0.277s (± 4.74%) 0.277s (± 7.84%) ~ 0.251s 0.299s p=0.810 n=6
Bind Time 0.000s (±244.70%) 0.000s ~ ~ ~ p=0.405 n=6
Check Time 2.331s (± 0.97%) 2.258s (± 0.74%) 🟩-0.073s (- 3.11%) 2.242s 2.288s p=0.005 n=6
Emit Time 0.228s (± 2.63%) 0.247s (± 3.46%) 🔻+0.019s (+ 8.35%) 0.240s 0.263s p=0.005 n=6
Total Time 29.845s (± 0.84%) 28.886s (± 0.96%) 🟩-0.959s (- 3.21%) 28.610s 29.195s p=0.005 n=6
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 337,634 332,123 -5,511 (- 1.63%) ~ ~ p=0.001 n=6
Types 199,520 196,635 -2,885 (- 1.45%) ~ ~ p=0.001 n=6
Memory Used 332,123k (± 0.02%) 331,071k (± 0.03%) -1,052k (- 0.32%) 330,896k 331,196k p=0.005 n=6
Memory Allocs 2,416,529 (± 0.02%) 2,412,493 (± 0.02%) -4,036 (- 0.17%) 2,411,919 2,413,067 p=0.005 n=6
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Parse Time 0.132s (± 7.07%) 0.130s (± 4.38%) ~ 0.124s 0.140s p=1.000 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 1.405s (± 1.20%) 1.256s (± 0.71%) 🟩-0.149s (-10.60%) 1.240s 1.264s p=0.005 n=6
Emit Time 0.086s (± 3.37%) 0.109s (± 6.54%) 🔻+0.023s (+27.10%) 0.099s 0.121s p=0.005 n=6
Total Time 1.674s (± 1.41%) 1.550s (± 0.84%) 🟩-0.124s (- 7.43%) 1.526s 1.565s p=0.005 n=6
ts-pre-modules - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 97,488 97,488 ~ ~ ~ p=1.000 n=6
Types 356 356 ~ ~ ~ p=1.000 n=6
Memory Used 133,452k (± 0.01%) 133,437k (± 0.01%) ~ 133,425k 133,472k p=0.077 n=6
Memory Allocs 182,896 (± 0.22%) 183,123 (± 0.18%) ~ 182,560 183,442 p=0.378 n=6
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Parse Time 0.113s (± 2.68%) 0.116s (± 5.45%) ~ 0.108s 0.127s p=0.260 n=6
Bind Time 0.039s (± 9.10%) 0.039s (±12.86%) ~ 0.031s 0.045s p=0.936 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Total Time 0.156s (± 2.80%) 0.159s (± 5.07%) ~ 0.148s 0.168s p=0.335 n=6
vscode - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 6,633,038 6,158,609 🟩-474,429 (- 7.15%) ~ ~ p=0.001 n=6
Types 2,350,636 2,150,189 🟩-200,447 (- 8.53%) ~ ~ p=0.001 n=6
Memory Used 4,500,200k (± 0.01%) 4,292,522k (± 0.02%) 🟩-207,679k (- 4.61%) 4,291,197k 4,293,236k p=0.005 n=6
Memory Allocs 31,708,706 (± 0.04%) 30,602,376 (± 0.13%) 🟩-1,106,330 (- 3.49%) 30,567,590 30,675,835 p=0.005 n=6
Config Time 0.072s (±12.07%) 0.072s (± 3.92%) ~ 0.069s 0.076s p=0.936 n=6
Parse Time 0.860s (± 5.21%) 0.906s (± 7.27%) ~ 0.850s 1.033s p=0.297 n=6
Bind Time 0.180s (±39.69%) 0.148s (±22.81%) ~ 0.129s 0.216s p=0.335 n=6
Check Time 8.616s (± 0.55%) 7.920s (± 0.87%) 🟩-0.696s (- 8.07%) 7.840s 8.041s p=0.005 n=6
Emit Time 2.193s (± 9.45%) 2.263s (± 6.82%) ~ 1.975s 2.395s p=0.689 n=6
Total Time 11.941s (± 1.19%) 11.386s (± 0.67%) 🟩-0.554s (- 4.64%) 11.276s 11.461s p=0.005 n=6
webpack - native
Errors 2 2 ~ ~ ~ p=1.000 n=6
Symbols 181,653 181,653 ~ ~ ~ p=1.000 n=6
Types 340 340 ~ ~ ~ p=1.000 n=6
Memory Used 219,256k (± 0.07%) 219,438k (± 0.04%) +182k (+ 0.08%) 219,293k 219,545k p=0.031 n=6
Memory Allocs 1,061,228 (± 0.45%) 1,065,514 (± 0.35%) +4,286 (+ 0.40%) 1,062,233 1,072,192 p=0.045 n=6
Config Time 0.012s (±13.23%) 0.012s (± 4.38%) ~ 0.012s 0.013s p=1.000 n=6
Parse Time 0.152s (± 3.55%) 0.151s (± 3.97%) ~ 0.140s 0.158s p=0.687 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.045s (±26.27%) 0.048s (±21.31%) ~ 0.037s 0.063s p=0.521 n=6
Total Time 0.210s (± 4.82%) 0.212s (± 6.96%) ~ 0.197s 0.235s p=0.936 n=6
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,063,023 991,543 🟩-71,480 (- 6.72%) ~ ~ p=0.001 n=6
Types 387,762 354,697 🟩-33,065 (- 8.53%) ~ ~ p=0.001 n=6
Memory Used 641,557k (± 0.02%) 610,312k (± 0.04%) 🟩-31,245k (- 4.87%) 609,963k 610,670k p=0.005 n=6
Memory Allocs 5,043,915 (± 0.05%) 4,769,873 (± 0.08%) 🟩-274,042 (- 5.43%) 4,762,655 4,774,414 p=0.005 n=6
Config Time 0.005s 0.005s (±17.48%) ~ 0.003s 0.005s p=0.405 n=6
Parse Time 0.131s (± 4.57%) 0.136s (± 5.36%) ~ 0.125s 0.147s p=0.229 n=6
Bind Time 0.037s (±27.83%) 0.036s (±15.80%) ~ 0.029s 0.042s p=0.872 n=6
Check Time 1.300s (± 1.04%) 1.464s (± 0.94%) 🔻+0.164s (+12.63%) 1.447s 1.481s p=0.005 n=6
Emit Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Total Time 1.478s (± 0.50%) 1.650s (± 0.79%) 🔻+0.172s (+11.64%) 1.635s 1.666s p=0.005 n=6
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

DanielRosenwasser
DanielRosenwasser reviewed Jun 16, 2026
View reviewed changes

@DanielRosenwasser DanielRosenwasser left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems really neat. I think the algorithm is mostly understandable, but would prefer some more comments at each point to explain what's happening (e.g. at each loop, it's not immediately clear what we're about to do next)

Comment thread internal/compiler/checkerpool.go Outdated
Comment thread internal/compiler/checkerpool.go Outdated
Comment thread internal/compiler/checkerpool.go Outdated
Comment thread internal/compiler/checkerpool.go Outdated
Copilot AI reviewed Jun 16, 2026
View reviewed changes

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 2 out of 2 changed files in this pull request and generated 2 comments.

Comment thread internal/compiler/checkerpool.go Outdated
Comment thread internal/compiler/checkerpool.go Outdated
@jakebailey

jakebailey commented Jun 16, 2026

Copy link
Copy Markdown
Member Author

@typescript-bot perf test this faster

@typescript-automation

typescript-automation Bot commented Jun 16, 2026 •
edited
Loading

Copy link
Copy Markdown

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
perf test this faster ✅ Started 👀 Results

@typescript-automation

typescript-automation Bot commented Jun 16, 2026

Copy link
Copy Markdown

@jakebailey
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 4 4 ~ ~ ~ p=1.000 n=6
Symbols 81,777 (± 0.02%) 81,648 (± 0.02%) -129 (- 0.16%) 81,631 81,686 p=0.005 n=6
Types 98,821 98,040 -781 (- 0.79%) ~ ~ p=0.001 n=6
Memory Used 180,298k (± 0.57%) 182,462k (± 0.60%) +2,164k (+ 1.20%) 180,739k 183,654k p=0.020 n=6
Memory Allocs 1,577,295 (± 0.01%) 1,575,462 (± 0.01%) -1,833 (- 0.12%) 1,575,296 1,575,804 p=0.005 n=6
Config Time 0.000s (±244.70%) 0.000s ~ ~ ~ p=0.405 n=6
Parse Time 0.065s (± 6.35%) 0.062s (±12.52%) ~ 0.050s 0.072s p=0.574 n=6
Bind Time 0.016s (±21.91%) 0.017s (±30.86%) ~ 0.013s 0.027s p=0.936 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.849s (± 1.11%) 0.794s (± 1.78%) 🟩-0.055s (- 6.44%) 0.783s 0.821s p=0.005 n=6
Total Time 0.931s (± 1.17%) 0.874s (± 2.18%) 🟩-0.057s (- 6.10%) 0.856s 0.900s p=0.005 n=6
angular-1 - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 876,696 (± 0.04%) 838,986 (± 0.24%) 🟩-37,710 (- 4.30%) 837,350 842,827 p=0.005 n=6
Types 263,750 (± 0.00%) 241,510 (± 0.00%) 🟩-22,240 (- 8.43%) 241,508 241,511 p=0.005 n=6
Memory Used 830,275k (± 0.05%) 813,503k (± 0.06%) -16,772k (- 2.02%) 812,806k 814,169k p=0.005 n=6
Memory Allocs 6,901,527 (± 0.22%) 6,798,486 (± 0.17%) -103,040 (- 1.49%) 6,780,726 6,810,033 p=0.005 n=6
Config Time 0.018s (± 6.85%) 0.017s (± 2.38%) ~ 0.017s 0.018s p=0.527 n=6
Parse Time 0.249s (± 5.81%) 0.242s (± 2.49%) ~ 0.232s 0.248s p=0.520 n=6
Bind Time 0.047s (±37.49%) 0.059s (±38.76%) ~ 0.035s 0.099s p=0.336 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 1.865s (± 1.80%) 1.939s (± 1.65%) +0.075s (+ 3.99%) 1.903s 1.998s p=0.008 n=6
Total Time 2.190s (± 1.53%) 2.287s (± 2.03%) 🔻+0.097s (+ 4.43%) 2.246s 2.378s p=0.008 n=6
mui-docs - native
Errors 11,242 (± 0.01%) 11,243 (± 0.03%) ~ 11,237 11,246 p=0.250 n=6
Symbols 4,209,747 3,919,939 🟩-289,808 (- 6.88%) ~ ~ p=0.001 n=6
Types 1,532,197 1,335,393 🟩-196,804 (-12.84%) ~ ~ p=0.001 n=6
Memory Used 4,961,978k (± 0.05%) 4,698,587k (± 0.08%) 🟩-263,391k (- 5.31%) 4,694,422k 4,704,376k p=0.005 n=6
Memory Allocs 73,773,977 (± 9.60%) 83,643,543 (±27.22%) ~ 63,490,585 121,718,979 p=0.936 n=6
Config Time 0.018s (±10.05%) 0.016s (± 4.65%) ~ 0.015s 0.017s p=0.081 n=6
Parse Time 0.928s (±14.14%) 1.084s (±32.30%) ~ 0.782s 1.684s p=0.810 n=6
Bind Time 0.002s 0.002s ~ ~ ~ p=1.000 n=6
Check Time 16.953s (± 0.57%) 17.523s (± 0.68%) +0.570s (+ 3.36%) 17.386s 17.737s p=0.005 n=6
Emit Time 0.450s (± 4.91%) 0.453s (± 4.35%) ~ 0.431s 0.473s p=0.573 n=6
Total Time 19.076s (± 0.92%) 19.736s (± 1.54%) +0.659s (+ 3.46%) 19.400s 20.263s p=0.008 n=6
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,394,138 1,365,530 -28,608 (- 2.05%) ~ ~ p=0.001 n=6
Types 442,153 420,781 🟩-21,372 (- 4.83%) ~ ~ p=0.001 n=6
Memory Used 1,651,957k (± 0.37%) 1,616,664k (± 0.22%) -35,293k (- 2.14%) 1,612,538k 1,620,922k p=0.005 n=6
Memory Allocs 55,653,668 (± 0.09%) 53,771,790 (± 0.05%) 🟩-1,881,878 (- 3.38%) 53,738,756 53,816,940 p=0.005 n=6
Config Time 0.016s (±37.31%) 0.022s (±31.23%) ~ 0.014s 0.032s p=0.149 n=6
Parse Time 0.275s (± 5.97%) 0.266s (± 6.06%) ~ 0.251s 0.297s p=0.470 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 2.327s (± 0.70%) 2.297s (± 0.52%) -0.030s (- 1.28%) 2.277s 2.313s p=0.031 n=6
Emit Time 0.223s (± 3.26%) 0.251s (± 6.44%) 🔻+0.028s (+12.47%) 0.236s 0.281s p=0.005 n=6
Total Time 29.655s (± 0.77%) 28.637s (± 1.43%) 🟩-1.019s (- 3.43%) 28.306s 29.439s p=0.008 n=6
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 337,634 331,555 -6,079 (- 1.80%) ~ ~ p=0.001 n=6
Types 199,520 196,291 -3,229 (- 1.62%) ~ ~ p=0.001 n=6
Memory Used 332,417k (± 0.03%) 330,867k (± 0.02%) -1,551k (- 0.47%) 330,763k 330,966k p=0.005 n=6
Memory Allocs 2,416,561 (± 0.02%) 2,411,042 (± 0.01%) -5,519 (- 0.23%) 2,410,698 2,411,578 p=0.005 n=6
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Parse Time 0.131s (± 4.34%) 0.131s (± 4.48%) ~ 0.125s 0.141s p=0.936 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 1.384s (± 0.75%) 1.245s (± 1.24%) 🟩-0.138s (-10.01%) 1.228s 1.269s p=0.005 n=6
Emit Time 0.096s (± 6.17%) 0.103s (± 5.92%) ~ 0.093s 0.109s p=0.128 n=6
Total Time 1.664s (± 0.98%) 1.534s (± 0.87%) 🟩-0.131s (- 7.84%) 1.511s 1.545s p=0.005 n=6
ts-pre-modules - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 97,488 97,488 ~ ~ ~ p=1.000 n=6
Types 356 356 ~ ~ ~ p=1.000 n=6
Memory Used 133,695k (± 0.01%) 133,723k (± 0.01%) +28k (+ 0.02%) 133,710k 133,750k p=0.020 n=6
Memory Allocs 183,094 (± 0.19%) 183,186 (± 0.17%) ~ 182,895 183,736 p=1.000 n=6
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Parse Time 0.114s (± 5.81%) 0.114s (± 4.99%) ~ 0.106s 0.119s p=1.000 n=6
Bind Time 0.041s (± 8.30%) 0.040s (±18.36%) ~ 0.029s 0.051s p=0.572 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Total Time 0.159s (± 4.26%) 0.157s (± 5.87%) ~ 0.148s 0.171s p=0.689 n=6
vscode - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 6,633,022 6,295,465 🟩-337,557 (- 5.09%) ~ ~ p=0.001 n=6
Types 2,354,036 2,199,025 🟩-155,011 (- 6.58%) ~ ~ p=0.001 n=6
Memory Used 4,510,892k (± 0.01%) 4,360,235k (± 0.02%) 🟩-150,657k (- 3.34%) 4,359,121k 4,361,039k p=0.005 n=6
Memory Allocs 31,826,206 (± 0.10%) 30,900,164 (± 0.08%) -926,042 (- 2.91%) 30,881,393 30,945,764 p=0.005 n=6
Config Time 0.068s (± 8.41%) 0.073s (± 5.55%) ~ 0.068s 0.078s p=0.126 n=6
Parse Time 0.890s (± 2.92%) 0.892s (± 3.68%) ~ 0.857s 0.948s p=0.748 n=6
Bind Time 0.131s (± 2.43%) 0.171s (±36.05%) ~ 0.129s 0.269s p=0.148 n=6
Check Time 8.747s (± 1.80%) 8.759s (± 0.55%) ~ 8.693s 8.814s p=0.230 n=6
Emit Time 2.285s (± 7.35%) 2.307s (±10.16%) ~ 1.987s 2.477s p=0.229 n=6
Total Time 12.136s (± 0.90%) 12.280s (± 1.35%) ~ 12.073s 12.461s p=0.128 n=6
webpack - native
Errors 2 2 ~ ~ ~ p=1.000 n=6
Symbols 181,893 181,893 ~ ~ ~ p=1.000 n=6
Types 340 340 ~ ~ ~ p=1.000 n=6
Memory Used 219,848k (± 0.13%) 219,918k (± 0.09%) ~ 219,651k 220,167k p=0.936 n=6
Memory Allocs 1,060,813 (± 0.33%) 1,071,025 (± 0.54%) +10,212 (+ 0.96%) 1,066,183 1,080,150 p=0.005 n=6
Config Time 0.010s (±13.21%) 0.011s (±12.26%) ~ 0.009s 0.013s p=0.676 n=6
Parse Time 0.153s (± 3.34%) 0.153s (± 5.29%) ~ 0.138s 0.162s p=0.936 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.039s (±20.39%) 0.041s (±22.97%) ~ 0.032s 0.058s p=0.688 n=6
Total Time 0.202s (± 4.97%) 0.206s (± 3.60%) ~ 0.195s 0.217s p=0.470 n=6
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,065,023 1,003,461 🟩-61,562 (- 5.78%) ~ ~ p=0.001 n=6
Types 389,185 355,325 🟩-33,860 (- 8.70%) ~ ~ p=0.001 n=6
Memory Used 643,144k (± 0.02%) 614,036k (± 0.02%) 🟩-29,108k (- 4.53%) 613,930k 614,251k p=0.005 n=6
Memory Allocs 5,062,673 (± 0.07%) 4,811,864 (± 0.14%) 🟩-250,809 (- 4.95%) 4,805,662 4,821,124 p=0.005 n=6
Config Time 0.004s (±23.57%) 0.005s ~ ~ ~ p=0.073 n=6
Parse Time 0.134s (± 2.00%) 0.133s (± 3.34%) ~ 0.130s 0.139s p=0.623 n=6
Bind Time 0.033s (±22.53%) 0.039s (±23.25%) ~ 0.027s 0.050s p=0.228 n=6
Check Time 1.310s (± 0.37%) 1.313s (± 1.59%) ~ 1.294s 1.340s p=0.575 n=6
Emit Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Total Time 1.486s (± 0.35%) 1.499s (± 1.33%) ~ 1.478s 1.525s p=0.298 n=6
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@jakebailey

jakebailey commented Jun 16, 2026

Copy link
Copy Markdown
Member Author

Weird. Simplifying the algorithm to just use text made it a lot worse in time?

@jakebailey

jakebailey commented Jun 29, 2026

Copy link
Copy Markdown
Member Author

@typescript-bot perf test this faster

@typescript-automation

typescript-automation Bot commented Jun 29, 2026 •
edited
Loading

Copy link
Copy Markdown

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
perf test this faster ✅ Started 👀 Results

@typescript-automation

typescript-automation Bot commented Jun 30, 2026

Copy link
Copy Markdown

@jakebailey
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 4 4 ~ ~ ~ p=1.000 n=6
Symbols 81,767 (± 0.03%) 81,623 (± 0.02%) -145 (- 0.18%) 81,589 81,649 p=0.005 n=6
Types 98,821 98,040 -781 (- 0.79%) ~ ~ p=0.001 n=6
Memory Used 179,959k (± 0.47%) 182,360k (± 0.59%) +2,401k (+ 1.33%) 180,487k 183,437k p=0.013 n=6
Memory Allocs 2,547,262 (± 0.01%) 2,545,221 (± 0.01%) -2,042 (- 0.08%) 2,545,060 2,545,385 p=0.005 n=6
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Parse Time 0.055s (±11.20%) 0.054s (± 4.74%) ~ 0.051s 0.058s p=0.935 n=6
Bind Time 0.019s (±18.20%) 0.019s (±22.37%) ~ 0.015s 0.024s p=0.935 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.877s (± 1.37%) 0.822s (± 1.24%) 🟩-0.055s (- 6.25%) 0.813s 0.837s p=0.005 n=6
Total Time 0.952s (± 1.25%) 0.896s (± 1.08%) 🟩-0.056s (- 5.86%) 0.884s 0.909s p=0.005 n=6
angular-1 - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 876,924 (± 0.09%) 838,383 (± 0.17%) 🟩-38,541 (- 4.40%) 836,428 839,610 p=0.005 n=6
Types 263,749 (± 0.00%) 241,509 (± 0.00%) 🟩-22,240 (- 8.43%) 241,508 241,510 p=0.005 n=6
Memory Used 831,093k (± 0.08%) 813,637k (± 0.08%) -17,456k (- 2.10%) 812,687k 814,446k p=0.005 n=6
Memory Allocs 12,660,858 (± 0.25%) 12,544,415 (± 0.19%) -116,443 (- 0.92%) 12,530,609 12,593,223 p=0.005 n=6
Config Time 0.017s (± 2.38%) 0.017s (± 2.38%) ~ 0.017s 0.018s p=1.000 n=6
Parse Time 0.255s (± 2.66%) 0.246s (± 2.86%) ~ 0.239s 0.256s p=0.078 n=6
Bind Time 0.052s (±24.80%) 0.047s (±32.69%) ~ 0.035s 0.074s p=0.630 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 1.911s (± 2.02%) 1.998s (± 0.47%) 🔻+0.087s (+ 4.53%) 1.987s 2.010s p=0.005 n=6
Total Time 2.252s (± 0.99%) 2.331s (± 0.72%) +0.079s (+ 3.50%) 2.308s 2.355s p=0.005 n=6
mui-docs - native
Errors 11,279 (± 0.03%) 11,281 (± 0.01%) ~ 11,279 11,282 p=0.607 n=6
Symbols 4,750,724 3,795,873 🟩-954,851 (-20.10%) ~ ~ p=0.001 n=6
Types 1,703,820 1,299,794 🟩-404,026 (-23.71%) ~ ~ p=0.001 n=6
Memory Used 5,926,736k (± 0.01%) 4,012,862k (± 0.03%) 🟩-1,913,874k (-32.29%) 4,011,126k 4,014,732k p=0.005 n=6
Memory Allocs 55,959,471 (± 0.08%) 40,015,507 (± 0.10%) 🟩-15,943,964 (-28.49%) 39,943,859 40,051,299 p=0.005 n=6
Config Time 0.016s (± 3.16%) 0.016s ~ ~ ~ p=0.174 n=6
Parse Time 0.537s (± 2.93%) 0.544s (± 2.18%) ~ 0.526s 0.557s p=0.298 n=6
Bind Time 0.002s 0.002s (±18.82%) ~ 0.002s 0.003s p=0.405 n=6
Check Time 17.498s (± 0.17%) 17.790s (± 0.90%) +0.292s (+ 1.67%) 17.680s 18.066s p=0.005 n=6
Emit Time 0.445s (± 4.31%) 0.459s (± 3.75%) ~ 0.436s 0.476s p=0.128 n=6
Total Time 19.259s (± 0.19%) 19.521s (± 1.23%) +0.262s (+ 1.36%) 19.297s 19.852s p=0.008 n=6
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,394,272 1,365,564 -28,708 (- 2.06%) ~ ~ p=0.001 n=6
Types 442,242 420,819 🟩-21,423 (- 4.84%) ~ ~ p=0.001 n=6
Memory Used 1,650,225k (± 0.10%) 1,617,416k (± 0.13%) -32,809k (- 1.99%) 1,615,001k 1,620,929k p=0.005 n=6
Memory Allocs 98,373,948 (± 0.05%) 96,506,066 (± 0.04%) -1,867,882 (- 1.90%) 96,460,572 96,551,438 p=0.005 n=6
Config Time 0.020s (±12.72%) 0.014s (±50.57%) ~ 0.008s 0.023s p=0.334 n=6
Parse Time 0.269s (± 3.05%) 0.268s (± 7.94%) ~ 0.230s 0.290s p=0.748 n=6
Bind Time 0.000s (±244.70%) 0.000s ~ ~ ~ p=0.405 n=6
Check Time 2.319s (± 0.63%) 2.293s (± 0.73%) -0.026s (- 1.10%) 2.264s 2.312s p=0.031 n=6
Emit Time 0.291s (± 2.96%) 0.291s (± 2.32%) ~ 0.283s 0.299s p=0.873 n=6
Total Time 30.385s (± 0.45%) 28.928s (± 1.09%) 🟩-1.456s (- 4.79%) 28.426s 29.372s p=0.005 n=6
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 337,637 331,557 -6,080 (- 1.80%) ~ ~ p=0.001 n=6
Types 199,520 196,291 -3,229 (- 1.62%) ~ ~ p=0.001 n=6
Memory Used 332,565k (± 0.05%) 330,940k (± 0.03%) -1,625k (- 0.49%) 330,758k 331,017k p=0.005 n=6
Memory Allocs 4,761,121 (± 0.01%) 4,754,906 (± 0.02%) -6,215 (- 0.13%) 4,753,654 4,755,959 p=0.005 n=6
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Parse Time 0.122s (± 2.36%) 0.125s (± 2.35%) ~ 0.121s 0.130s p=0.104 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 1.374s (± 0.43%) 1.246s (± 1.46%) 🟩-0.127s (- 9.25%) 1.222s 1.267s p=0.005 n=6
Emit Time 0.128s (± 6.51%) 0.115s (± 8.65%) 🟩-0.012s (- 9.80%) 0.108s 0.135s p=0.036 n=6
Total Time 1.678s (± 0.86%) 1.539s (± 1.18%) 🟩-0.138s (- 8.24%) 1.512s 1.560s p=0.005 n=6
ts-pre-modules - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 97,488 97,488 ~ ~ ~ p=1.000 n=6
Types 356 356 ~ ~ ~ p=1.000 n=6
Memory Used 133,727k (± 0.02%) 133,726k (± 0.03%) ~ 133,682k 133,782k p=0.936 n=6
Memory Allocs 182,535 (± 0.13%) 182,804 (± 0.22%) ~ 182,285 183,305 p=0.230 n=6
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Parse Time 0.109s (± 5.97%) 0.110s (± 3.85%) ~ 0.104s 0.115s p=0.574 n=6
Bind Time 0.040s (± 8.95%) 0.039s (±19.59%) ~ 0.030s 0.047s p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Total Time 0.153s (± 3.69%) 0.153s (± 4.74%) ~ 0.145s 0.164s p=1.000 n=6
vscode - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 6,825,484 6,400,705 🟩-424,779 (- 6.22%) ~ ~ p=0.001 n=6
Types 2,412,968 2,233,986 🟩-178,982 (- 7.42%) ~ ~ p=0.001 n=6
Memory Used 4,631,020k (± 0.02%) 4,452,349k (± 0.02%) 🟩-178,671k (- 3.86%) 4,451,593k 4,453,710k p=0.005 n=6
Memory Allocs 32,947,671 (± 0.07%) 31,944,013 (± 0.04%) 🟩-1,003,657 (- 3.05%) 31,934,732 31,971,301 p=0.005 n=6
Config Time 0.079s (± 8.64%) 0.069s (± 9.15%) 🟩-0.010s (-12.08%) 0.061s 0.077s p=0.020 n=6
Parse Time 0.893s (± 2.69%) 0.890s (± 2.24%) ~ 0.852s 0.908s p=0.936 n=6
Bind Time 0.158s (±35.60%) 0.151s (±22.80%) ~ 0.135s 0.222s p=0.572 n=6
Check Time 8.631s (± 0.76%) 8.509s (± 1.03%) -0.122s (- 1.41%) 8.427s 8.668s p=0.045 n=6
Emit Time 2.357s (± 7.52%) 2.455s (± 6.36%) ~ 2.159s 2.604s p=0.128 n=6
Total Time 12.137s (± 0.64%) 12.153s (± 0.60%) ~ 12.070s 12.269s p=0.936 n=6
webpack - native
Errors 2 2 ~ ~ ~ p=1.000 n=6
Symbols 184,308 184,308 ~ ~ ~ p=1.000 n=6
Types 340 340 ~ ~ ~ p=1.000 n=6
Memory Used 224,292k (± 0.15%) 224,158k (± 0.06%) ~ 223,921k 224,253k p=0.689 n=6
Memory Allocs 1,085,849 (± 0.51%) 1,090,251 (± 1.24%) ~ 1,081,421 1,116,865 p=1.000 n=6
Config Time 0.011s (± 9.67%) 0.011s (±11.65%) ~ 0.009s 0.012s p=0.931 n=6
Parse Time 0.152s (± 3.40%) 0.151s (± 3.22%) ~ 0.145s 0.156s p=0.935 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.041s (±24.99%) 0.047s (±21.76%) ~ 0.036s 0.061s p=0.298 n=6
Total Time 0.204s (± 6.79%) 0.209s (± 4.87%) ~ 0.198s 0.227s p=0.810 n=6
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,065,144 1,003,348 🟩-61,796 (- 5.80%) ~ ~ p=0.001 n=6
Types 389,314 355,318 🟩-33,996 (- 8.73%) ~ ~ p=0.001 n=6
Memory Used 643,865k (± 0.02%) 614,520k (± 0.02%) 🟩-29,345k (- 4.56%) 614,279k 614,669k p=0.005 n=6
Memory Allocs 5,103,941 (± 0.18%) 4,856,310 (± 0.21%) 🟩-247,631 (- 4.85%) 4,845,252 4,875,040 p=0.005 n=6
Config Time 0.005s (±11.05%) 0.005s (± 8.44%) ~ 0.004s 0.005s p=0.595 n=6
Parse Time 0.132s (± 3.78%) 0.131s (± 1.74%) ~ 0.128s 0.133s p=0.686 n=6
Bind Time 0.031s (±18.94%) 0.032s (±24.49%) ~ 0.025s 0.044s p=0.936 n=6
Check Time 1.316s (± 0.62%) 1.331s (± 1.22%) ~ 1.310s 1.347s p=0.173 n=6
Emit Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Total Time 1.488s (± 0.65%) 1.510s (± 0.67%) +0.022s (+ 1.48%) 1.499s 1.522s p=0.008 n=6
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@jakebailey

jakebailey commented Jun 30, 2026

Copy link
Copy Markdown
Member Author

That is the result I'm expecting, FWIW.

Is this PR explained enough?

@ahejlsberg

ahejlsberg commented Jun 30, 2026

Copy link
Copy Markdown
Member

I like the improvements, even if it mostly seems to be around memory consumption. I'm surprised the initial compile time improvement for VS Code evaporated. Any idea why?

@jakebailey

jakebailey commented Jun 30, 2026

Copy link
Copy Markdown
Member Author

It was my last change; the weird count stuff is apparently load bearing in vscode. I'm going to have to think about a more principled way to weight files...

@jakebailey

jakebailey commented Jun 30, 2026

Copy link
Copy Markdown
Member Author

Hm, so it seems like the effect from the "complexity" estimation is more important than I thought. The import graph still matters, but just shifting files around by how complicated they look does seem to matter even more.

I had copilot do a big matrix of different things and am about to push a new one which changes the algorithm again to, which it described as:

Phase 1: Work-balanced initial assignment

Use LPT, or longest-processing-time-first scheduling.

for each source file:
    weight = file.NodeCount + len(file.Text) / 100

sort files by descending weight, preserving file order for ties

for each file in sorted order:
    checker = checker with the smallest current total weight
    assign file to checker
    checker.totalWeight += file.weight

This directly targets the critical path: wall-clock check time is bounded by the slowest checker bucket.

Phase 2: Import-graph locality refinement

Build an undirected graph where two files are adjacent if one imports the other.

for a small fixed number of passes:
    for each file:
        count how many import neighbors are assigned to each checker
        candidate = checker with the largest neighbor-locality gain

        if candidate improves locality and stays under the load cap:
            move file to candidate

The load cap is roughly averageCheckerWeight + 2%, but never below the largest single file weight.

Summary

The ordering is the important part: balance checker work first, then improve import locality within that balance budget. LPT gives a good max-load baseline, and graph refinement recovers checker cache locality without being allowed to create a new overloaded checker.

@jakebailey
Use LPT for checker file assignment
d3c9d0a 
Assign files to checkers with longest-processing-time-first scheduling
before running the import-graph refinement pass. The estimated work for a
file is now its node count plus one unit per 100 bytes of source text,
which better tracks checker work than source text size alone.

Measured on ~/work/vscode/src with tsgo -p . --noEmit
--extendedDiagnostics, 5-run average versus the current text+graph
assignment:

- current text+graph: Check time 9.168s, Total time 10.298s,
  Symbols 6,407,330, Types 2,217,598, Memory 4,394,421K, Allocs
  24,807,475.
- pre-text old-weight+graph: Check time 8.740s (-4.7%), Total time
  10.028s (-2.6%), Symbols -0.5%, Types -0.8%, Memory -0.5%, Allocs
  -0.2%.
- LPT node+text+graph: Check time 8.457s (-7.8%), Total time 9.587s
  (-6.9%), Symbols +0.9%, Types +1.2%, Memory +0.5%, Allocs +0.7%.
- LPT old-weight+graph: Check time 8.485s (-7.5%), Total time 9.632s
  (-6.5%), Symbols ~, Types +0.3%, Memory -0.2%, Allocs +0.2%.

The import graph remains useful: removing graph refinement from the LPT
variants preserved some check-time improvement but increased symbols,
types, memory, and allocations by roughly 4-8% on this benchmark.
@jakebailey

jakebailey commented Jun 30, 2026

Copy link
Copy Markdown
Member Author

@typescript-bot perf test this faster

@typescript-automation

typescript-automation Bot commented Jun 30, 2026 •
edited
Loading

Copy link
Copy Markdown

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
perf test this faster ✅ Started 👀 Results

@jakebailey jakebailey changed the title Assign checkers with import-aware algorithm Assign checkers with cost/import-aware algorithm Jun 30, 2026
@typescript-automation

typescript-automation Bot commented Jun 30, 2026

Copy link
Copy Markdown

@jakebailey
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 4 4 ~ ~ ~ p=1.000 n=6
Symbols 81,766 (± 0.04%) 81,980 (± 0.03%) +214 (+ 0.26%) 81,956 82,019 p=0.005 n=6
Types 98,821 98,587 -234 (- 0.24%) ~ ~ p=0.001 n=6
Memory Used 180,352k (± 0.34%) 180,013k (± 0.65%) ~ 177,934k 180,783k p=0.936 n=6
Memory Allocs 2,539,258 (± 0.01%) 2,538,169 (± 0.01%) -1,090 (- 0.04%) 2,537,888 2,538,479 p=0.005 n=6
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Parse Time 0.057s (± 7.92%) 0.056s (± 5.16%) ~ 0.050s 0.058s p=0.936 n=6
Bind Time 0.016s (±19.98%) 0.017s (± 5.26%) ~ 0.016s 0.018s p=0.371 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.885s (± 0.61%) 0.794s (± 1.62%) 🟩-0.091s (-10.27%) 0.782s 0.812s p=0.005 n=6
Total Time 0.960s (± 1.01%) 0.868s (± 1.30%) 🟩-0.093s (- 9.63%) 0.856s 0.883s p=0.005 n=6
angular-1 - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 876,299 (± 0.22%) 835,471 (± 0.12%) 🟩-40,828 (- 4.66%) 834,032 836,319 p=0.005 n=6
Types 263,954 (± 0.00%) 240,044 (± 0.00%) 🟩-23,910 (- 9.06%) 240,042 240,045 p=0.005 n=6
Memory Used 830,863k (± 0.06%) 814,447k (± 0.08%) -16,417k (- 1.98%) 813,906k 815,648k p=0.005 n=6
Memory Allocs 12,518,747 (± 0.08%) 12,392,942 (± 0.09%) -125,806 (- 1.00%) 12,385,333 12,414,764 p=0.005 n=6
Config Time 0.017s (± 3.72%) 0.017s (± 3.10%) ~ 0.016s 0.017s p=0.386 n=6
Parse Time 0.253s (± 7.06%) 0.251s (± 9.26%) ~ 0.222s 0.276s p=0.936 n=6
Bind Time 0.059s (±31.85%) 0.053s (±24.01%) ~ 0.041s 0.073s p=0.572 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 1.952s (± 1.17%) 1.941s (± 2.26%) ~ 1.894s 2.023s p=0.378 n=6
Total Time 2.294s (± 0.91%) 2.282s (± 2.06%) ~ 2.217s 2.363s p=0.471 n=6
mui-docs - native
Errors 11,281 (± 0.01%) 11,281 (± 0.02%) ~ 11,277 11,282 p=0.720 n=6
Symbols 4,715,834 4,514,786 🟩-201,048 (- 4.26%) ~ ~ p=0.001 n=6
Types 1,700,615 1,656,922 -43,693 (- 2.57%) ~ ~ p=0.001 n=6
Memory Used 5,813,946k (± 0.03%) 5,634,975k (± 0.04%) 🟩-178,971k (- 3.08%) 5,632,377k 5,637,596k p=0.005 n=6
Memory Allocs 55,293,258 (± 0.04%) 53,469,432 (± 0.06%) 🟩-1,823,827 (- 3.30%) 53,435,459 53,531,336 p=0.005 n=6
Config Time 0.016s (± 2.52%) 0.017s (± 7.26%) ~ 0.016s 0.019s p=0.527 n=6
Parse Time 0.537s (± 3.73%) 0.536s (± 2.70%) ~ 0.519s 0.556s p=1.000 n=6
Bind Time 0.002s 0.002s ~ ~ ~ p=1.000 n=6
Check Time 17.338s (± 0.18%) 17.531s (± 0.27%) +0.193s (+ 1.12%) 17.471s 17.612s p=0.005 n=6
Emit Time 0.486s (± 4.95%) 0.484s (± 4.87%) ~ 0.466s 0.516s p=0.378 n=6
Total Time 19.108s (± 0.18%) 19.374s (± 0.43%) +0.266s (+ 1.39%) 19.304s 19.538s p=0.005 n=6
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 1,394,272 1,386,556 -7,716 (- 0.55%) ~ ~ p=0.001 n=6
Types 442,245 438,844 -3,401 (- 0.77%) ~ ~ p=0.001 n=6
Memory Used 1,657,096k (± 0.26%) 1,644,807k (± 0.46%) -12,290k (- 0.74%) 1,636,826k 1,657,913k p=0.020 n=6
Memory Allocs 97,724,990 (± 0.05%) 96,960,258 (± 0.08%) -764,733 (- 0.78%) 96,865,511 97,031,199 p=0.005 n=6
Config Time 0.015s (±35.17%) 0.016s (±53.83%) ~ 0.008s 0.028s p=0.872 n=6
Parse Time 0.270s (± 8.07%) 0.281s (± 2.79%) ~ 0.272s 0.293s p=0.378 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 2.349s (± 0.16%) 1.984s (± 0.72%) 🟩-0.365s (-15.52%) 1.959s 1.998s p=0.005 n=6
Emit Time 0.303s (± 3.78%) 0.301s (± 5.22%) ~ 0.287s 0.330s p=0.574 n=6
Total Time 30.720s (± 1.21%) 26.310s (± 0.79%) 🟩-4.409s (-14.35%) 25.920s 26.524s p=0.005 n=6
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 337,637 335,716 -1,921 (- 0.57%) ~ ~ p=0.001 n=6
Types 199,520 198,124 -1,396 (- 0.70%) ~ ~ p=0.001 n=6
Memory Used 332,524k (± 0.04%) 334,230k (± 0.03%) +1,706k (+ 0.51%) 334,088k 334,367k p=0.005 n=6
Memory Allocs 4,718,004 (± 0.01%) 4,721,743 (± 0.01%) +3,739 (+ 0.08%) 4,720,722 4,722,331 p=0.005 n=6
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Parse Time 0.130s (± 4.77%) 0.130s (± 3.96%) ~ 0.122s 0.135s p=0.872 n=6
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Check Time 1.389s (± 0.79%) 0.999s (± 1.08%) 🟩-0.390s (-28.06%) 0.990s 1.020s p=0.005 n=6
Emit Time 0.131s (± 9.18%) 0.130s (± 9.33%) ~ 0.111s 0.148s p=0.810 n=6
Total Time 1.702s (± 1.35%) 1.315s (± 1.07%) 🟩-0.387s (-22.74%) 1.287s 1.326s p=0.005 n=6
ts-pre-modules - native
Errors 3 3 ~ ~ ~ p=1.000 n=6
Symbols 97,488 97,488 ~ ~ ~ p=1.000 n=6
Types 356 356 ~ ~ ~ p=1.000 n=6
Memory Used 133,722k (± 0.02%) 133,702k (± 0.01%) ~ 133,671k 133,716k p=0.574 n=6
Memory Allocs 180,521 (± 0.21%) 180,677 (± 0.16%) ~ 180,164 180,958 p=0.471 n=6
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Parse Time 0.115s (± 4.54%) 0.114s (± 4.72%) ~ 0.106s 0.122s p=0.624 n=6
Bind Time 0.037s (±11.84%) 0.042s (±11.36%) ~ 0.038s 0.049s p=0.121 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=6
Total Time 0.155s (± 3.03%) 0.159s (± 1.93%) ~ 0.156s 0.164s p=0.147 n=6
vscode - native
Errors 0 0 ~ ~ ~ p=1.000 n=6
Symbols 6,848,354 6,535,717 🟩-312,637 (- 4.57%) ~ ~ p=0.001 n=6
Types 2,419,521 2,283,785 🟩-135,736 (- 5.61%) ~ ~ p=0.001 n=6
Memory Used 4,653,024k (± 0.04%) 4,531,470k (± 0.02%) -121,554k (- 2.61%) 4,530,360k 4,532,672k p=0.005 n=6
Memory Allocs 32,110,610 (± 0.18%) 31,312,222 (± 0.07%) -798,388 (- 2.49%) 31,285,947 31,337,183 p=0.005 n=6
Config Time 0.073s (± 8.64%) 0.073s (±13.18%) ~ 0.062s 0.087s p=0.936 n=6
Parse Time 0.886s (± 4.07%) 0.895s (± 2.60%) ~ 0.867s 0.931s p=0.630 n=6
Bind Time 0.186s (±33.70%) 0.184s (±37.63%) ~ 0.148s 0.323s p=0.630 n=6
Check Time 8.813s (± 1.31%) 9.093s (± 0.79%) +0.280s (+ 3.18%) 9.016s 9.202s p=0.005 n=6
Emit Time 2.247s (± 9.25%) 2.373s (±10.22%) ~ 2.047s 2.571s p=0.173 n=6
Total Time 12.230s (± 0.71%) 12.697s (± 1.05%) +0.467s (+ 3.82%) 12.476s 12.852s p=0.005 n=6
webpack - native
Errors 2 2 ~ ~ ~ p=1.000 n=6
Symbols 184,308 184,308 ~ ~ ~ p=1.000 n=6
Types 340 340 ~ ~ ~ p=1.000 n=6
Memory Used 224,186k (± 0.21%) 224,315k (± 0.14%) ~ 223,972k 224,737k p=0.471 n=6
Memory Allocs 937,073 (± 0.61%) 942,695 (± 0.62%) ~ 936,393 952,798 p=0.173 n=6
Config Time 0.012s (± 6.61%) 0.010s (± 7.40%) 🟩-0.002s (-17.57%) 0.009s 0.011s p=0.007 n=6
Parse Time 0.155s (± 4.39%) 0.153s (± 4.74%) ~ 0.142s 0.163s p=0.574 n=6
Bind Time 0s 0s ~ ~ ~ p=1.000 n=6
Check Time 0s 0s ~ ~ ~ p=1.000 n=6
Emit Time 0.040s (±12.43%) 0.050s (±20.51%) ~ 0.039s 0.067s p=0.054 n=6
Total Time 0.208s (± 3.98%) 0.214s (± 4.96%) ~ 0.202s 0.225s p=0.228 n=6
xstate-main - native
Errors 0 5 🔻+5 (+ ∞%) ~ ~ p=0.001 n=6
Symbols 1,065,075 1,026,446 🟩-38,629 (- 3.63%) ~ ~ p=0.001 n=6
Types 391,128 376,623 🟩-14,505 (- 3.71%) ~ ~ p=0.001 n=6
Memory Used 644,647k (± 0.02%) 632,133k (± 0.02%) -12,514k (- 1.94%) 631,998k 632,250k p=0.005 n=6
Memory Allocs 5,025,242 (± 0.19%) 4,913,082 (± 0.16%) -112,160 (- 2.23%) 4,902,691 4,922,885 p=0.005 n=6
Config Time 0.004s (±18.82%) 0.005s (± 8.44%) ~ 0.004s 0.005s p=0.248 n=6
Parse Time 0.131s (± 6.14%) 0.139s (± 3.73%) ~ 0.130s 0.144s p=0.091 n=6
Bind Time 0.037s (±29.51%) 0.036s (±22.42%) ~ 0.028s 0.046s p=1.000 n=6
Check Time 1.313s (± 0.42%) 1.389s (± 1.25%) 🔻+0.076s (+ 5.76%) 1.366s 1.409s p=0.005 n=6
Emit Time 0.001s 0.001s ~ ~ ~ p=1.000 n=6
Total Time 1.490s (± 0.65%) 1.579s (± 1.09%) 🔻+0.089s (+ 5.94%) 1.562s 1.603s p=0.005 n=6
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 6
Baseline baseline 6

Developer Information:

Download Benchmarks

@jakebailey

jakebailey commented Jun 30, 2026

Copy link
Copy Markdown
Member Author

Uh oh, xstate has some checker association dependence.

@jakebailey jakebailey mentioned this pull request Jul 1, 2026
Draft
@DanielRosenwasser DanielRosenwasser mentioned this pull request Jul 31, 2026
Open
@jakebailey

jakebailey commented Jul 31, 2026

Copy link
Copy Markdown
Member Author

@typescript-bot perf test this faster

@typescript-automation

typescript-automation Bot commented Jul 31, 2026 •
edited
Loading

Copy link
Copy Markdown

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
perf test this faster ✅ Started 👀 Results

@jakebailey

jakebailey commented Jul 31, 2026

Copy link
Copy Markdown
Member Author

Preliminary perf results versus current main.

VS Code — 7 runs, median timings

Metric main This PR Change
Check time 8.216s 7.625s -7.2%
Total time 9.306s 8.739s -6.1%
Symbols 6,892,214 6,386,728 -7.3%
Types 2,427,746 2,205,303 -9.2%
Instantiations 3,630,659 3,238,825 -10.8%
Memory used 4,597,219K 4,343,155K -5.5%
Memory allocations 25,169,847 23,845,835 -5.3%

Strada compiler — 12 alternating runs, median timings

Metric main This PR Change
Check time 1.038s 0.771s -25.7%
Total time 1.273s 0.996s -21.8%
Symbols 337,502 335,784 -0.5%
Types 199,429 197,583 -0.9%
Instantiations 251,470 247,925 -1.4%
Memory used 317,811K 318,533K +0.2%
Memory allocations 4,622,154 4,641,564 +0.4%
Max RSS 493,884K 492,556K -0.3%

@typescript-automation

typescript-automation Bot commented Jul 31, 2026

Copy link
Copy Markdown

@jakebailey
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 41 41 ~ ~ ~ p=1.000 n=12
Symbols 119,733 115,937 🟩-3,796 (- 3.17%) ~ ~ p=0.000 n=12
Types 99,032 96,938 -2,094 (- 2.11%) ~ ~ p=0.000 n=12
Memory Used 151,365k (± 0.48%) 148,479k (± 0.41%) -2,886k (- 1.91%) 147,184k 150,320k p=0.000 n=12
Memory Allocs 2,262,889 (± 0.00%) 2,247,458 (± 0.00%) -15,431 (- 0.68%) 2,247,236 2,247,627 p=0.000 n=12
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Parse Time 0.041s (± 4.12%) 0.040s (± 3.60%) ~ 0.036s 0.044s p=0.386 n=12
Bind Time 0.013s (±14.55%) 0.014s (±10.35%) ~ 0.011s 0.017s p=0.637 n=12
Check Time 0.729s (± 0.54%) 0.500s (± 0.39%) 🟩-0.230s (-31.49%) 0.494s 0.504s p=0.000 n=12
Emit Time 0.284s (± 2.46%) 0.267s (± 1.78%) 🟩-0.017s (- 5.99%) 0.254s 0.280s p=0.001 n=12
Total Time 1.074s (± 0.69%) 0.827s (± 0.64%) 🟩-0.247s (-22.99%) 0.813s 0.840s p=0.000 n=12
angular-1 - native
Errors 3 3 ~ ~ ~ p=1.000 n=12
Symbols 871,799 (± 0.14%) 808,270 (± 0.07%) 🟩-63,529 (- 7.29%) 806,687 809,600 p=0.000 n=12
Types 263,961 (± 0.00%) 225,910 (± 0.00%) 🟩-38,051 (-14.42%) 225,905 225,922 p=0.000 n=12
Memory Used 806,379k (± 0.07%) 771,218k (± 0.03%) 🟩-35,161k (- 4.36%) 770,687k 771,710k p=0.000 n=12
Memory Allocs 13,119,512 (± 0.04%) 12,911,060 (± 0.06%) -208,452 (- 1.59%) 12,905,494 12,951,165 p=0.000 n=12
Config Time 0.016s (± 1.90%) 0.016s ~ ~ ~ p=0.093 n=12
Parse Time 0.281s (± 2.48%) 0.277s (± 1.95%) ~ 0.261s 0.293s p=0.115 n=12
Bind Time 0.061s (± 9.84%) 0.060s (± 3.15%) ~ 0.058s 0.069s p=0.727 n=12
Check Time 0s 0s ~ ~ ~ p=1.000 n=12
Emit Time 1.687s (± 0.52%) 1.760s (± 0.87%) 🔻+0.073s (+ 4.33%) 1.725s 1.820s p=0.000 n=12
Total Time 2.054s (± 0.53%) 2.130s (± 0.82%) +0.076s (+ 3.72%) 2.096s 2.204s p=0.000 n=12
mui-docs - native
Errors 11,276 (± 0.04%) 11,279 (± 0.01%) ~ 11,277 11,282 p=0.173 n=12
Symbols 4,387,605 3,825,684 🟩-561,921 (-12.81%) ~ ~ p=0.000 n=12
Types 1,540,346 1,461,150 🟩-79,196 (- 5.14%) ~ ~ p=0.000 n=12
Memory Used 4,965,588k (± 0.03%) 3,990,081k (± 0.05%) 🟩-975,506k (-19.65%) 3,985,244k 3,994,680k p=0.000 n=12
Memory Allocs 45,306,475 (± 0.04%) 44,146,737 (± 0.04%) -1,159,738 (- 2.56%) 44,093,449 44,181,300 p=0.000 n=12
Config Time 0.016s 0.016s (± 1.55%) ~ 0.015s 0.016s p=0.478 n=12
Parse Time 0.551s (± 2.47%) 0.557s (± 1.90%) ~ 0.528s 0.579s p=0.542 n=12
Bind Time 0.002s 0.002s ~ ~ ~ p=1.000 n=12
Check Time 16.292s (± 0.46%) 17.904s (± 0.51%) 🔻+1.612s (+ 9.89%) 17.783s 18.151s p=0.000 n=12
Emit Time 0.453s (± 2.59%) 0.434s (± 0.57%) 🟩-0.019s (- 4.23%) 0.429s 0.443s p=0.000 n=12
Total Time 18.038s (± 0.44%) 19.618s (± 0.54%) 🔻+1.579s (+ 8.75%) 19.434s 19.897s p=0.000 n=12
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 1,394,491 1,377,075 -17,416 (- 1.25%) ~ ~ p=0.000 n=12
Types 442,212 429,398 -12,814 (- 2.90%) ~ ~ p=0.000 n=12
Memory Used 1,630,629k (± 0.20%) 1,605,958k (± 0.16%) -24,671k (- 1.51%) 1,600,794k 1,615,936k p=0.000 n=12
Memory Allocs 97,044,592 (± 0.02%) 95,913,254 (± 0.01%) -1,131,338 (- 1.17%) 95,871,046 95,943,520 p=0.000 n=12
Config Time 0.004s (±12.12%) 0.004s (±16.26%) ~ 0.002s 0.005s p=1.000 n=12
Parse Time 0.199s (± 2.48%) 0.198s (± 1.81%) ~ 0.191s 0.207s p=0.433 n=12
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Check Time 2.043s (± 0.43%) 1.888s (± 0.30%) 🟩-0.155s (- 7.58%) 1.870s 1.902s p=0.000 n=12
Emit Time 0.300s (± 4.22%) 0.322s (± 4.11%) 🔻+0.022s (+ 7.16%) 0.298s 0.359s p=0.032 n=12
Total Time 27.437s (± 0.53%) 24.912s (± 0.76%) 🟩-2.525s (- 9.20%) 24.469s 25.412s p=0.000 n=12
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 337,834 336,831 -1,003 (- 0.30%) ~ ~ p=0.000 n=12
Types 199,561 198,154 -1,407 (- 0.71%) ~ ~ p=0.000 n=12
Memory Used 318,314k (± 0.02%) 319,314k (± 0.03%) +1,000k (+ 0.31%) 319,113k 319,466k p=0.000 n=12
Memory Allocs 4,659,379 (± 0.01%) 4,681,270 (± 0.01%) +21,891 (+ 0.47%) 4,679,445 4,682,661 p=0.000 n=12
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=12
Parse Time 0.113s (± 3.50%) 0.118s (± 4.40%) ~ 0.103s 0.128s p=0.109 n=12
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Check Time 1.216s (± 0.44%) 0.890s (± 0.91%) 🟩-0.326s (-26.84%) 0.873s 0.910s p=0.000 n=12
Emit Time 0.164s (± 5.64%) 0.177s (± 3.88%) 🔻+0.014s (+ 8.40%) 0.160s 0.198s p=0.034 n=12
Total Time 1.548s (± 0.79%) 1.237s (± 0.80%) 🟩-0.310s (-20.05%) 1.211s 1.259s p=0.000 n=12
ts-pre-modules - native
Errors 87 87 ~ ~ ~ p=1.000 n=12
Symbols 302,246 301,813 -433 (- 0.14%) ~ ~ p=0.000 n=12
Types 181,594 181,166 -428 (- 0.24%) ~ ~ p=0.000 n=12
Memory Used 274,438k (± 0.02%) 275,976k (± 0.02%) +1,538k (+ 0.56%) 275,816k 276,111k p=0.000 n=12
Memory Allocs 1,661,179 (± 0.01%) 1,656,893 (± 0.01%) -4,286 (- 0.26%) 1,656,546 1,657,616 p=0.000 n=12
Config Time 0.000s (±217.90%) 0.000s (±113.79%) ~ 0.000s 0.001s p=0.590 n=12
Parse Time 0.098s (± 3.36%) 0.106s (± 2.59%) 🔻+0.008s (+ 7.99%) 0.098s 0.113s p=0.001 n=12
Bind Time 0.036s (± 9.28%) 0.039s (±13.88%) ~ 0.028s 0.051s p=0.541 n=12
Check Time 0.989s (± 0.81%) 0.891s (± 0.69%) 🟩-0.098s (- 9.94%) 0.872s 0.907s p=0.000 n=12
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Total Time 1.136s (± 0.59%) 1.050s (± 0.58%) 🟩-0.086s (- 7.60%) 1.037s 1.065s p=0.000 n=12
vscode - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 7,596,130 7,119,186 🟩-476,944 (- 6.28%) ~ ~ p=0.000 n=12
Types 2,646,722 2,416,215 🟩-230,507 (- 8.71%) ~ ~ p=0.000 n=12
Memory Used 5,071,141k (± 0.02%) 4,823,120k (± 0.02%) 🟩-248,021k (- 4.89%) 4,820,894k 4,826,174k p=0.000 n=12
Memory Allocs 38,561,208 (± 0.04%) 37,051,098 (± 0.02%) 🟩-1,510,110 (- 3.92%) 37,039,687 37,064,630 p=0.000 n=12
Config Time 0.059s (± 0.67%) 0.059s (± 0.66%) ~ 0.058s 0.060s p=0.118 n=12
Parse Time 1.487s (± 1.37%) 1.480s (± 1.54%) ~ 1.430s 1.538s p=0.600 n=12
Bind Time 0.324s (± 9.01%) 0.306s (± 0.43%) ~ 0.301s 0.309s p=0.189 n=12
Check Time 9.373s (± 0.99%) 9.090s (± 0.20%) 🟩-0.283s (- 3.02%) 9.008s 9.112s p=0.002 n=12
Emit Time 2.944s (± 9.86%) 2.694s (± 0.57%) 🟩-0.251s (- 8.52%) 2.657s 2.724s p=0.000 n=12
Total Time 14.205s (± 1.54%) 13.702s (± 0.22%) 🟩-0.504s (- 3.55%) 13.618s 13.756s p=0.000 n=12
webpack - native
Errors 2 2 ~ ~ ~ p=1.000 n=12
Symbols 196,816 196,816 ~ ~ ~ p=1.000 n=12
Types 340 340 ~ ~ ~ p=1.000 n=12
Memory Used 230,865k (± 0.12%) 230,657k (± 0.09%) ~ 230,059k 231,325k p=0.443 n=12
Memory Allocs 974,309 (± 0.23%) 978,042 (± 0.22%) ~ 974,000 986,937 p=0.060 n=12
Config Time 0.008s (± 3.00%) 0.009s (± 6.60%) ~ 0.008s 0.010s p=0.252 n=12
Parse Time 0.200s (± 2.54%) 0.196s (± 4.71%) ~ 0.175s 0.214s p=0.639 n=12
Bind Time 0s 0s ~ ~ ~ p=1.000 n=12
Check Time 0s 0s ~ ~ ~ p=1.000 n=12
Emit Time 0.057s (±13.10%) 0.067s (±15.35%) ~ 0.050s 0.095s p=0.057 n=12
Total Time 0.265s (± 1.47%) 0.272s (± 2.52%) ~ 0.254s 0.292s p=0.075 n=12
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 1,066,055 979,263 🟩-86,792 (- 8.14%) ~ ~ p=0.000 n=12
Types 392,847 347,166 🟩-45,681 (-11.63%) ~ ~ p=0.000 n=12
Memory Used 633,744k (± 0.01%) 578,436k (± 0.01%) 🟩-55,308k (- 8.73%) 578,263k 578,576k p=0.000 n=12
Memory Allocs 4,919,609 (± 0.03%) 4,566,178 (± 0.03%) 🟩-353,431 (- 7.18%) 4,561,836 4,568,345 p=0.000 n=12
Config Time 0.003s 0.003s ~ ~ ~ p=1.000 n=12
Parse Time 0.151s (± 3.08%) 0.152s (± 2.88%) ~ 0.139s 0.160s p=0.723 n=12
Bind Time 0.050s (±20.87%) 0.045s (±18.59%) ~ 0.034s 0.072s p=0.853 n=12
Check Time 1.281s (± 0.53%) 1.947s (± 0.63%) 🔻+0.666s (+52.01%) 1.930s 1.986s p=0.000 n=12
Emit Time 0.001s 0.001s ~ ~ ~ p=1.000 n=12
Total Time 1.492s (± 0.71%) 2.157s (± 0.52%) 🔻+0.665s (+44.59%) 2.135s 2.187s p=0.000 n=12
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 12
Baseline baseline 12

Developer Information:

Download Benchmarks

@jakebailey
jakebailey marked this pull request as draft July 31, 2026 21:33
@jakebailey

jakebailey commented Jul 31, 2026

Copy link
Copy Markdown
Member Author

@typescript-bot perf test this faster

@typescript-automation

typescript-automation Bot commented Jul 31, 2026 •
edited
Loading

Copy link
Copy Markdown

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
perf test this faster ✅ Started 👀 Results

@typescript-automation

typescript-automation Bot commented Jul 31, 2026

Copy link
Copy Markdown

@jakebailey
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 41 41 ~ ~ ~ p=1.000 n=12
Symbols 119,733 118,775 -958 (- 0.80%) ~ ~ p=0.000 n=12
Types 99,032 98,290 -742 (- 0.75%) ~ ~ p=0.000 n=12
Memory Used 151,225k (± 0.46%) 150,988k (± 0.57%) ~ 149,021k 152,937k p=0.799 n=12
Memory Allocs 2,262,965 (± 0.00%) 2,259,000 (± 0.00%) -3,965 (- 0.18%) 2,258,820 2,259,210 p=0.000 n=12
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Parse Time 0.040s (± 3.95%) 0.041s (± 3.77%) ~ 0.037s 0.044s p=0.853 n=12
Bind Time 0.012s (± 9.82%) 0.012s (±12.99%) ~ 0.010s 0.019s p=0.361 n=12
Check Time 0.732s (± 0.75%) 0.525s (± 0.72%) 🟩-0.207s (-28.23%) 0.516s 0.534s p=0.000 n=12
Emit Time 0.287s (± 1.20%) 0.273s (± 2.14%) 🟩-0.014s (- 4.74%) 0.262s 0.288s p=0.002 n=12
Total Time 1.078s (± 0.61%) 0.857s (± 0.69%) 🟩-0.221s (-20.50%) 0.845s 0.875s p=0.000 n=12
angular-1 - native
Errors 3 3 ~ ~ ~ p=1.000 n=12
Symbols 872,614 (± 0.11%) 847,693 (± 0.06%) -24,921 (- 2.86%) 846,435 849,613 p=0.000 n=12
Types 263,961 (± 0.00%) 249,047 (± 0.00%) 🟩-14,914 (- 5.65%) 249,044 249,051 p=0.000 n=12
Memory Used 806,339k (± 0.04%) 794,673k (± 0.05%) -11,665k (- 1.45%) 793,541k 795,477k p=0.000 n=12
Memory Allocs 13,123,998 (± 0.10%) 13,049,988 (± 0.02%) -74,011 (- 0.56%) 13,044,378 13,058,560 p=0.000 n=12
Config Time 0.017s (± 1.99%) 0.017s (± 1.86%) ~ 0.016s 0.017s p=0.680 n=12
Parse Time 0.279s (± 2.05%) 0.282s (± 2.73%) ~ 0.256s 0.299s p=0.417 n=12
Bind Time 0.061s (± 8.34%) 0.063s (±10.27%) ~ 0.058s 0.089s p=0.624 n=12
Check Time 0s 0s ~ ~ ~ p=1.000 n=12
Emit Time 1.703s (± 1.40%) 1.675s (± 0.89%) -0.028s (- 1.63%) 1.645s 1.739s p=0.008 n=12
Total Time 2.069s (± 1.32%) 2.053s (± 0.87%) ~ 2.022s 2.133s p=0.139 n=12
mui-docs - native
Errors 11,277 (± 0.03%) 11,278 (± 0.02%) ~ 11,269 11,282 p=0.897 n=12
Symbols 4,387,605 4,033,914 🟩-353,691 (- 8.06%) ~ ~ p=0.000 n=12
Types 1,540,346 1,575,142 +34,796 (+ 2.26%) ~ ~ p=0.000 n=12
Memory Used 4,965,830k (± 0.03%) 4,174,849k (± 0.02%) 🟩-790,981k (-15.93%) 4,171,771k 4,176,838k p=0.000 n=12
Memory Allocs 45,315,563 (± 0.03%) 45,945,239 (± 0.04%) +629,676 (+ 1.39%) 45,898,958 45,986,519 p=0.000 n=12
Config Time 0.016s (± 1.55%) 0.016s ~ ~ ~ p=0.478 n=12
Parse Time 0.549s (± 2.40%) 0.554s (± 2.21%) ~ 0.512s 0.581s p=0.560 n=12
Bind Time 0.002s 0.002s ~ ~ ~ p=1.000 n=12
Check Time 16.325s (± 0.48%) 14.915s (± 0.32%) 🟩-1.410s (- 8.64%) 14.818s 15.038s p=0.000 n=12
Emit Time 0.450s (± 2.27%) 0.454s (± 2.56%) ~ 0.436s 0.479s p=0.943 n=12
Total Time 18.068s (± 0.45%) 16.670s (± 0.12%) 🟩-1.399s (- 7.74%) 16.601s 16.715s p=0.000 n=12
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 1,394,491 1,392,292 -2,199 (- 0.16%) ~ ~ p=0.000 n=12
Types 442,212 443,118 +906 (+ 0.20%) ~ ~ p=0.000 n=12
Memory Used 1,634,419k (± 0.22%) 1,636,172k (± 0.36%) ~ 1,620,529k 1,647,070k p=0.478 n=12
Memory Allocs 97,065,099 (± 0.04%) 96,723,647 (± 0.04%) -341,453 (- 0.35%) 96,608,527 96,797,596 p=0.000 n=12
Config Time 0.003s (± 9.48%) 0.003s (±12.29%) ~ 0.002s 0.004s p=1.000 n=12
Parse Time 0.197s (± 2.59%) 0.195s (± 1.91%) ~ 0.186s 0.207s p=0.744 n=12
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Check Time 2.033s (± 0.51%) 1.860s (± 0.65%) 🟩-0.173s (- 8.49%) 1.836s 1.894s p=0.000 n=12
Emit Time 0.300s (± 4.72%) 0.310s (± 4.01%) ~ 0.272s 0.339s p=0.385 n=12
Total Time 27.333s (± 0.68%) 25.450s (± 0.56%) 🟩-1.883s (- 6.89%) 25.146s 25.780s p=0.000 n=12
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 337,834 338,124 +290 (+ 0.09%) ~ ~ p=0.000 n=12
Types 199,561 198,606 -955 (- 0.48%) ~ ~ p=0.000 n=12
Memory Used 318,305k (± 0.02%) 319,777k (± 0.02%) +1,472k (+ 0.46%) 319,617k 319,953k p=0.000 n=12
Memory Allocs 4,659,386 (± 0.01%) 4,660,809 (± 0.01%) +1,423 (+ 0.03%) 4,659,284 4,662,481 p=0.000 n=12
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=12
Parse Time 0.117s (± 4.61%) 0.116s (± 4.66%) ~ 0.103s 0.131s p=0.831 n=12
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Check Time 1.214s (± 0.49%) 1.065s (± 0.70%) 🟩-0.149s (-12.25%) 1.049s 1.082s p=0.000 n=12
Emit Time 0.174s (± 3.99%) 0.158s (± 6.18%) 🟩-0.016s (- 9.43%) 0.136s 0.186s p=0.010 n=12
Total Time 1.561s (± 0.58%) 1.391s (± 0.89%) 🟩-0.170s (-10.90%) 1.364s 1.420s p=0.000 n=12
ts-pre-modules - native
Errors 87 87 ~ ~ ~ p=1.000 n=12
Symbols 302,246 305,220 +2,974 (+ 0.98%) ~ ~ p=0.000 n=12
Types 181,594 181,907 +313 (+ 0.17%) ~ ~ p=0.000 n=12
Memory Used 274,470k (± 0.01%) 277,584k (± 0.02%) +3,114k (+ 1.13%) 277,462k 277,744k p=0.000 n=12
Memory Allocs 1,661,346 (± 0.01%) 1,625,572 (± 0.01%) -35,774 (- 2.15%) 1,625,252 1,625,997 p=0.000 n=12
Config Time 0.000s (±217.90%) 0.000s (±217.90%) ~ 0.000s 0.001s p=1.000 n=12
Parse Time 0.100s (± 4.10%) 0.102s (± 4.69%) ~ 0.086s 0.112s p=0.310 n=12
Bind Time 0.039s (± 9.40%) 0.036s (± 9.36%) ~ 0.028s 0.047s p=0.234 n=12
Check Time 0.990s (± 0.62%) 0.843s (± 0.54%) 🟩-0.147s (-14.81%) 0.836s 0.857s p=0.000 n=12
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Total Time 1.142s (± 0.58%) 0.995s (± 0.80%) 🟩-0.147s (-12.84%) 0.972s 1.015s p=0.000 n=12
vscode - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 7,619,568 7,277,452 🟩-342,116 (- 4.49%) ~ ~ p=0.000 n=12
Types 2,648,938 2,507,090 🟩-141,848 (- 5.35%) ~ ~ p=0.000 n=12
Memory Used 5,079,345k (± 0.03%) 4,909,991k (± 0.02%) 🟩-169,354k (- 3.33%) 4,908,309k 4,912,326k p=0.000 n=12
Memory Allocs 38,593,305 (± 0.01%) 37,777,074 (± 0.01%) -816,230 (- 2.11%) 37,770,536 37,794,216 p=0.000 n=12
Config Time 0.058s (± 0.70%) 0.059s (± 0.53%) ~ 0.058s 0.059s p=0.100 n=12
Parse Time 1.511s (± 1.33%) 1.499s (± 1.88%) ~ 1.397s 1.549s p=0.580 n=12
Bind Time 0.306s (± 0.26%) 0.318s (± 8.44%) ~ 0.303s 0.454s p=0.873 n=12
Check Time 9.334s (± 0.48%) 9.224s (± 0.86%) -0.110s (- 1.18%) 8.840s 9.288s p=0.002 n=12
Emit Time 2.794s (± 1.59%) 2.915s (± 9.37%) ~ 2.739s 4.289s p=0.378 n=12
Total Time 14.018s (± 0.23%) 14.089s (± 1.48%) ~ 13.913s 15.133s p=0.370 n=12
webpack - native
Errors 2 2 ~ ~ ~ p=1.000 n=12
Symbols 196,816 196,816 ~ ~ ~ p=1.000 n=12
Types 340 340 ~ ~ ~ p=1.000 n=12
Memory Used 230,563k (± 0.04%) 230,697k (± 0.08%) ~ 230,472k 231,283k p=0.124 n=12
Memory Allocs 973,785 (± 0.17%) 977,538 (± 0.16%) +3,753 (+ 0.39%) 974,922 982,253 p=0.005 n=12
Config Time 0.008s 0.008s ~ ~ ~ p=1.000 n=12
Parse Time 0.190s (± 2.60%) 0.192s (± 2.43%) ~ 0.177s 0.201s p=0.723 n=12
Bind Time 0s 0s ~ ~ ~ p=1.000 n=12
Check Time 0s 0s ~ ~ ~ p=1.000 n=12
Emit Time 0.056s (±13.96%) 0.056s (±10.49%) ~ 0.048s 0.080s p=0.619 n=12
Total Time 0.255s (± 2.60%) 0.257s (± 1.70%) ~ 0.240s 0.266s p=0.401 n=12
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 1,066,055 1,041,224 -24,831 (- 2.33%) ~ ~ p=0.000 n=12
Types 392,847 376,449 🟩-16,398 (- 4.17%) ~ ~ p=0.000 n=12
Memory Used 633,718k (± 0.01%) 617,365k (± 0.01%) -16,353k (- 2.58%) 617,171k 617,550k p=0.000 n=12
Memory Allocs 4,919,642 (± 0.04%) 4,799,205 (± 0.03%) -120,436 (- 2.45%) 4,796,119 4,803,114 p=0.000 n=12
Config Time 0.003s 0.003s ~ ~ ~ p=1.000 n=12
Parse Time 0.151s (± 3.06%) 0.149s (± 2.81%) ~ 0.139s 0.163s p=0.580 n=12
Bind Time 0.051s (±18.63%) 0.045s (±16.40%) ~ 0.034s 0.066s p=0.283 n=12
Check Time 1.281s (± 0.65%) 1.197s (± 1.03%) 🟩-0.084s (- 6.58%) 1.176s 1.239s p=0.000 n=12
Emit Time 0.001s 0.001s ~ ~ ~ p=1.000 n=12
Total Time 1.492s (± 0.75%) 1.403s (± 0.97%) 🟩-0.088s (- 5.91%) 1.377s 1.448s p=0.000 n=12
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 12
Baseline baseline 12

Developer Information:

Download Benchmarks

@jakebailey

jakebailey commented Aug 1, 2026

Copy link
Copy Markdown
Member Author

@typescript-bot perf test this faster

@typescript-automation

typescript-automation Bot commented Aug 1, 2026 •
edited
Loading

Copy link
Copy Markdown

Starting jobs; this comment will be updated as builds start and complete.

Command Status Results
perf test this faster ✅ Started 👀 Results

@typescript-automation

typescript-automation Bot commented Aug 1, 2026

Copy link
Copy Markdown

@jakebailey
The results of the perf run you requested are in!

Here they are:

tsc

Comparison Report - baseline..pr
Metric baseline pr Delta Best Worst p-value
Compiler-Unions - native
Errors 41 41 ~ ~ ~ p=1.000 n=12
Symbols 119,733 115,452 🟩-4,281 (- 3.58%) ~ ~ p=0.000 n=12
Types 99,032 97,103 -1,929 (- 1.95%) ~ ~ p=0.000 n=12
Memory Used 150,965k (± 0.57%) 150,188k (± 0.35%) ~ 149,000k 151,500k p=0.198 n=12
Memory Allocs 2,262,945 (± 0.01%) 2,248,843 (± 0.00%) -14,101 (- 0.62%) 2,248,565 2,249,003 p=0.000 n=12
Config Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Parse Time 0.040s (± 3.11%) 0.041s (± 3.45%) ~ 0.038s 0.045s p=0.135 n=12
Bind Time 0.012s (±13.91%) 0.013s (±13.33%) ~ 0.010s 0.019s p=0.132 n=12
Check Time 0.730s (± 0.60%) 0.502s (± 0.90%) 🟩-0.227s (-31.18%) 0.492s 0.514s p=0.000 n=12
Emit Time 0.287s (± 0.89%) 0.270s (± 2.22%) 🟩-0.017s (- 5.87%) 0.260s 0.293s p=0.000 n=12
Total Time 1.074s (± 0.46%) 0.833s (± 0.88%) 🟩-0.242s (-22.48%) 0.813s 0.851s p=0.000 n=12
angular-1 - native
Errors 3 3 ~ ~ ~ p=1.000 n=12
Symbols 872,545 (± 0.11%) 847,427 (± 0.05%) -25,119 (- 2.88%) 846,800 848,679 p=0.000 n=12
Types 263,962 (± 0.00%) 249,047 (± 0.00%) 🟩-14,915 (- 5.65%) 249,046 249,049 p=0.000 n=12
Memory Used 806,628k (± 0.05%) 794,598k (± 0.05%) -12,030k (- 1.49%) 793,928k 795,892k p=0.000 n=12
Memory Allocs 13,124,842 (± 0.12%) 13,051,568 (± 0.05%) -73,275 (- 0.56%) 13,044,393 13,078,380 p=0.000 n=12
Config Time 0.017s (± 1.86%) 0.016s (± 1.75%) ~ 0.016s 0.017s p=0.100 n=12
Parse Time 0.273s (± 2.97%) 0.278s (± 2.01%) ~ 0.259s 0.293s p=0.259 n=12
Bind Time 0.071s (±19.44%) 0.061s (± 7.60%) ~ 0.057s 0.084s p=0.107 n=12
Check Time 0s 0s ~ ~ ~ p=1.000 n=12
Emit Time 1.711s (± 1.27%) 1.673s (± 1.02%) -0.038s (- 2.21%) 1.645s 1.746s p=0.001 n=12
Total Time 2.084s (± 1.62%) 2.047s (± 1.04%) -0.037s (- 1.76%) 2.022s 2.141s p=0.008 n=12
mui-docs - native
Errors 11,275 (± 0.05%) 11,277 (± 0.04%) ~ 11,262 11,282 p=0.557 n=12
Symbols 4,387,605 4,033,914 🟩-353,691 (- 8.06%) ~ ~ p=0.000 n=12
Types 1,540,346 1,575,142 +34,796 (+ 2.26%) ~ ~ p=0.000 n=12
Memory Used 4,965,848k (± 0.03%) 4,173,765k (± 0.04%) 🟩-792,082k (-15.95%) 4,168,880k 4,177,077k p=0.000 n=12
Memory Allocs 45,317,685 (± 0.04%) 45,942,716 (± 0.04%) +625,031 (+ 1.38%) 45,890,771 45,972,825 p=0.000 n=12
Config Time 0.016s 0.016s (± 1.81%) ~ 0.015s 0.016s p=0.217 n=12
Parse Time 0.550s (± 2.69%) 0.552s (± 2.22%) ~ 0.521s 0.582s p=0.877 n=12
Bind Time 0.002s 0.002s ~ ~ ~ p=1.000 n=12
Check Time 16.297s (± 0.50%) 14.798s (± 0.28%) 🟩-1.500s (- 9.20%) 14.739s 14.919s p=0.000 n=12
Emit Time 0.456s (± 2.69%) 0.440s (± 2.15%) 🟩-0.016s (- 3.51%) 0.430s 0.475s p=0.002 n=12
Total Time 18.028s (± 0.49%) 16.544s (± 0.21%) 🟩-1.484s (- 8.23%) 16.469s 16.656s p=0.000 n=12
self-build-src - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 1,394,491 1,392,292 -2,199 (- 0.16%) ~ ~ p=0.000 n=12
Types 442,212 443,118 +906 (+ 0.20%) ~ ~ p=0.000 n=12
Memory Used 1,633,226k (± 0.29%) 1,638,195k (± 0.40%) ~ 1,618,093k 1,658,996k p=0.198 n=12
Memory Allocs 97,045,521 (± 0.03%) 96,721,634 (± 0.05%) -323,888 (- 0.33%) 96,618,086 96,844,622 p=0.000 n=12
Config Time 0.003s (± 7.73%) 0.003s (±12.31%) ~ 0.002s 0.004s p=0.193 n=12
Parse Time 0.200s (± 2.45%) 0.195s (± 2.86%) ~ 0.182s 0.209s p=0.213 n=12
Bind Time 0.001s (±217.90%) 0.000s ~ ~ ~ p=1.000 n=12
Check Time 2.034s (± 0.38%) 1.853s (± 0.35%) 🟩-0.180s (- 8.87%) 1.835s 1.868s p=0.000 n=12
Emit Time 0.299s (± 5.29%) 0.307s (± 4.37%) ~ 0.278s 0.337s p=0.401 n=12
Total Time 27.375s (± 0.70%) 25.316s (± 0.76%) 🟩-2.059s (- 7.52%) 24.981s 25.988s p=0.000 n=12
self-compiler - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 337,834 338,124 +290 (+ 0.09%) ~ ~ p=0.000 n=12
Types 199,561 198,606 -955 (- 0.48%) ~ ~ p=0.000 n=12
Memory Used 318,352k (± 0.03%) 319,869k (± 0.08%) +1,517k (+ 0.48%) 319,522k 321,013k p=0.000 n=12
Memory Allocs 4,659,281 (± 0.01%) 4,660,849 (± 0.01%) +1,568 (+ 0.03%) 4,659,954 4,662,012 p=0.000 n=12
Config Time 0.001s 0.001s ~ ~ ~ p=1.000 n=12
Parse Time 0.113s (± 4.61%) 0.119s (± 3.63%) ~ 0.109s 0.127s p=0.070 n=12
Bind Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Check Time 1.220s (± 0.62%) 1.059s (± 0.67%) 🟩-0.160s (-13.12%) 1.040s 1.075s p=0.000 n=12
Emit Time 0.158s (± 6.66%) 0.160s (± 6.71%) ~ 0.126s 0.186s p=0.561 n=12
Total Time 1.546s (± 0.93%) 1.393s (± 0.70%) 🟩-0.153s (- 9.90%) 1.370s 1.416s p=0.000 n=12
ts-pre-modules - native
Errors 87 87 ~ ~ ~ p=1.000 n=12
Symbols 302,246 305,220 +2,974 (+ 0.98%) ~ ~ p=0.000 n=12
Types 181,594 181,907 +313 (+ 0.17%) ~ ~ p=0.000 n=12
Memory Used 274,419k (± 0.01%) 277,645k (± 0.02%) +3,226k (+ 1.18%) 277,507k 277,743k p=0.000 n=12
Memory Allocs 1,661,137 (± 0.01%) 1,625,633 (± 0.01%) -35,504 (- 2.14%) 1,625,249 1,626,188 p=0.000 n=12
Config Time 0.000s (±92.91%) 0.000s ~ ~ ~ p=0.093 n=12
Parse Time 0.101s (± 3.85%) 0.099s (± 6.13%) ~ 0.087s 0.112s p=0.660 n=12
Bind Time 0.038s (±12.49%) 0.039s (± 8.40%) ~ 0.030s 0.049s p=0.400 n=12
Check Time 0.995s (± 0.66%) 0.834s (± 0.77%) 🟩-0.161s (-16.17%) 0.821s 0.850s p=0.000 n=12
Emit Time 0.000s 0.000s ~ ~ ~ p=1.000 n=12
Total Time 1.147s (± 0.67%) 0.988s (± 0.84%) 🟩-0.159s (-13.87%) 0.971s 1.018s p=0.000 n=12
vscode - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 7,631,101 7,149,324 🟩-481,777 (- 6.31%) ~ ~ p=0.000 n=12
Types 2,654,831 2,453,001 🟩-201,830 (- 7.60%) ~ ~ p=0.000 n=12
Memory Used 5,084,004k (± 0.02%) 4,857,161k (± 0.02%) 🟩-226,843k (- 4.46%) 4,855,500k 4,859,871k p=0.000 n=12
Memory Allocs 38,635,097 (± 0.02%) 37,459,209 (± 0.02%) 🟩-1,175,888 (- 3.04%) 37,448,116 37,481,407 p=0.000 n=12
Config Time 0.058s (± 0.62%) 0.059s (± 0.62%) +0.001s (+ 1.15%) 0.058s 0.060s p=0.023 n=12
Parse Time 1.500s (± 1.83%) 1.489s (± 2.01%) ~ 1.390s 1.561s p=0.434 n=12
Bind Time 0.321s (± 9.79%) 0.331s (±10.97%) ~ 0.305s 0.480s p=0.127 n=12
Check Time 9.710s (± 0.83%) 8.833s (± 1.31%) 🟩-0.877s (- 9.03%) 8.436s 8.927s p=0.000 n=12
Emit Time 2.919s (± 8.66%) 2.913s (± 8.83%) -0.006s (- 0.20%) 2.697s 3.825s p=0.018 n=12
Total Time 14.523s (± 1.29%) 13.703s (± 1.18%) 🟩-0.819s (- 5.64%) 13.520s 14.289s p=0.000 n=12
webpack - native
Errors 2 2 ~ ~ ~ p=1.000 n=12
Symbols 196,816 196,816 ~ ~ ~ p=1.000 n=12
Types 340 340 ~ ~ ~ p=1.000 n=12
Memory Used 230,664k (± 0.08%) 230,577k (± 0.08%) ~ 230,033k 231,053k p=0.410 n=12
Memory Allocs 975,105 (± 0.26%) 977,979 (± 0.23%) +2,875 (+ 0.29%) 974,026 985,698 p=0.020 n=12
Config Time 0.008s (± 3.45%) 0.009s (± 6.68%) ~ 0.008s 0.010s p=0.126 n=12
Parse Time 0.203s (± 2.95%) 0.200s (± 2.20%) ~ 0.187s 0.209s p=0.270 n=12
Bind Time 0s 0s ~ ~ ~ p=1.000 n=12
Check Time 0s 0s ~ ~ ~ p=1.000 n=12
Emit Time 0.060s (±16.77%) 0.057s (± 8.51%) ~ 0.050s 0.079s p=0.296 n=12
Total Time 0.271s (± 2.42%) 0.266s (± 1.80%) ~ 0.250s 0.277s p=0.248 n=12
xstate-main - native
Errors 0 0 ~ ~ ~ p=1.000 n=12
Symbols 1,066,055 1,041,224 -24,831 (- 2.33%) ~ ~ p=0.000 n=12
Types 392,847 376,449 🟩-16,398 (- 4.17%) ~ ~ p=0.000 n=12
Memory Used 633,793k (± 0.02%) 617,384k (± 0.01%) -16,409k (- 2.59%) 617,106k 617,545k p=0.000 n=12
Memory Allocs 4,917,954 (± 0.03%) 4,798,032 (± 0.03%) -119,921 (- 2.44%) 4,794,966 4,802,324 p=0.000 n=12
Config Time 0.003s 0.003s ~ ~ ~ p=1.000 n=12
Parse Time 0.151s (± 3.56%) 0.150s (± 2.74%) ~ 0.143s 0.161s p=0.723 n=12
Bind Time 0.057s (±14.02%) 0.047s (±18.04%) ~ 0.035s 0.072s p=0.091 n=12
Check Time 1.277s (± 0.34%) 1.190s (± 0.52%) 🟩-0.087s (- 6.81%) 1.179s 1.205s p=0.000 n=12
Emit Time 0.001s 0.001s ~ ~ ~ p=1.000 n=12
Total Time 1.496s (± 0.36%) 1.399s (± 0.44%) 🟩-0.097s (- 6.49%) 1.384s 1.415s p=0.000 n=12
System info unknown
Hosts
  • native
Scenarios
  • Compiler-Unions - native
  • angular-1 - native
  • mui-docs - native
  • self-build-src - native
  • self-compiler - native
  • ts-pre-modules - native
  • vscode - native
  • webpack - native
  • xstate-main - native
Benchmark Name Iterations
Current pr 12
Baseline baseline 12

Developer Information:

Download Benchmarks

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot Copilot left review comments
@andrewbranch andrewbranch Awaiting requested review from andrewbranch
@ahejlsberg ahejlsberg Awaiting requested review from ahejlsberg
@RyanCavanaugh RyanCavanaugh Awaiting requested review from RyanCavanaugh
@DanielRosenwasser DanielRosenwasser Awaiting requested review from DanielRosenwasser

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

4 participants

@jakebailey @ahejlsberg @DanielRosenwasser