Commit Graph

121 Commits

Author SHA1 Message Date
Hansung Kim
18ecebddc0 sgemm_tcore: Fix round-down error with CORES_PER_CLUSTER 2024-05-16 21:36:24 -07:00
Hansung Kim
78b2a318c1 sgemm_tcore: Implement A transpose for coalesced smem access 2024-05-16 20:22:15 -07:00
Hansung Kim
8f64fae7a7 sgemm_tcore: Addr gen for local_k; add SIMT-only for reference 2024-05-16 14:11:09 -07:00
Hansung Kim
df1aa62916 sgemm_tcore: Add warptiling parameters
FIXME: accumulation is done wrong
2024-05-15 15:23:26 -07:00
Hansung Kim
5de8e7c33a sgemm_tg: Fix device address to use ELF operands 2024-05-13 23:09:57 -07:00
Hansung Kim
9d2b533d5c sgemm_tg: Do operand elf stitching for kernel.elf as well 2024-05-13 16:48:13 -07:00
Hansung Kim
09b23ffe87 sgemm_tg: 1-octet 8-lane kernel 2024-05-13 14:52:33 -07:00
Hansung Kim
d848e88f72 sgemm_tcore: Move C from regF->GMEM directly 2024-05-13 14:00:50 -07:00
Hansung Kim
9e60b1834c sgemm_tcore: Rewrite with sgemm_Wg parametrization 2024-05-13 13:22:06 -07:00
Hansung Kim
5c298c81df sgemm_tg: Use reg mapping functions 2024-05-12 22:22:54 -07:00
Hansung Kim
6af0c305ea Fix path to OBJCOPY 2024-05-08 13:27:11 -07:00
Hansung Kim
6ba6a1e2e5 Merge branch 'kernels' into tensor_core 2024-05-08 13:25:31 -07:00
Hansung Kim
7775830814 Hardcode chipyard device addresses 2024-05-07 16:30:30 -07:00
joshua
5bd25985c6 i kinda forgot most of changes 2024-05-04 23:01:47 -07:00
Hansung Kim
a606a9ef42 common.mk: properly handle unspecified CONFIG 2024-04-29 17:14:28 -07:00
Richard Yan
01f4a69ae9 dma mvout, double buffering & other opts 2024-04-28 01:18:51 -07:00
Richard Yan
d21e7b92c7 internal accumulation, forced rematerialization, better unrolling 2024-04-25 15:28:12 -07:00
Richard Yan
a44edf2b65 Merge branch 'kernels' of https://github.com/hansungk/vortex-private into kernels 2024-04-24 22:10:40 -07:00
Richard Yan
6eafa2de54 write operands to elf 2024-04-24 22:09:30 -07:00
Hansung Kim
df881fd69f Generate separate ELF for radiance 2024-04-24 21:10:21 -07:00
Hansung Kim
793779aa6c sgemm_wg: 128x128 config 2024-04-24 21:10:21 -07:00
Hansung Kim
689043b45e Add regression flops 2024-04-24 21:10:21 -07:00
Hansung Kim
6cbfbfb856 sgemm_wg: Output CPU data to binary 2024-04-24 21:10:21 -07:00
Richard Yan
4e9855dc33 highly unrolled a/b load 2024-04-16 22:19:30 -07:00
Richard Yan
449d99f0bb dram gemm kernel 2024-04-16 17:15:22 -07:00
Richard Yan
99621a0df9 Merge branch 'kernels' of https://github.com/hansungk/vortex-private into kernels 2024-04-15 10:22:19 -07:00
Richard Yan
0bb7aeb45b add gpu+gemmini gemm kernel 2024-04-15 10:13:37 -07:00
Hansung Kim
37a60b1141 sgemm_wg: Output C result to binary 2024-04-14 12:36:06 -07:00
Hansung Kim
3383b70732 sgemm_wg: Hardcode device address 2024-04-14 12:36:00 -07:00
Hansung Kim
93a00101ae sgemm_wg: revert to faster params 2024-04-04 21:06:14 -07:00
Hansung Kim
fa2b6e2ad0 sgemm_wg: Explicitly limit unroll to reduce stack spilling
This needs to be done case-by-case for different BK/TM/TN combinations and
examining the assembly.
2024-03-29 02:48:29 -07:00
Hansung Kim
537b97eb20 common.mk: Don't clean all *.elf 2024-03-28 20:17:26 -07:00
Hansung Kim
a9b0814211 sgemm_wg: Document tiling parameter constraints 2024-03-28 18:17:00 -07:00
Hansung Kim
9673db4e8c sgemm_wg: Fix possible divide-by-0 2024-03-28 17:35:47 -07:00
Hansung Kim
9555b790e7 sgemm_wg: ifdef-guard cluster specific code 2024-03-27 22:45:51 -07:00
Hansung Kim
09822764e7 sgemm_wg: Remove software-based barrier implementation
Intra-cluster barrier is now implemented in hardware, transparent to the ISA.
2024-03-27 22:43:45 -07:00
Hansung Kim
fa6adceb7e vecaddx: Hardcode args/input device address to match chipyard
Don't use mem_alloc/mem_free API
2024-03-27 15:15:52 -07:00
Hansung Kim
b545809496 vecaddx: Use -DRADIANCE 2024-03-26 16:42:36 -07:00
Hansung Kim
4d2c0084d1 common.mk: Compile separate cluster ELF
... using -DRADIANCE, which the kernel C code use explicitly to switch between
vx_spawn_tasks and vx_spawn_tasks_cluster.  This is to ease running both simX
and Chipyard simulations without mixing up binaries.
2024-03-26 16:37:44 -07:00
Hansung Kim
7f00e6c376 vecaddx: Change arg device address to 7fff0000 2024-03-26 10:44:33 -07:00
Hansung Kim
cc7b34ec5b vecaddx: Write args.bin and input.bin 2024-03-26 10:44:02 -07:00
Hansung Kim
8f3474b151 Don't clean *.bin 2024-03-24 01:45:08 -07:00
Hansung Kim
2036d37840 sgemm_wg: Prevent run-ahead using ternary flags; reduce mem accesses 2024-03-13 21:35:24 -07:00
Hansung Kim
510a834db5 sgemm_wg: Implement software barrier for inter-core synchronization 2024-03-12 15:34:42 -07:00
Hansung Kim
fbe872c831 sgemm_wg: Add missing makefile dep to common.h 2024-03-12 15:34:17 -07:00
Hansung Kim
6f4dfe5a0e sgemm_wg: Implement 2D threadtiling 2024-02-29 14:40:54 -08:00
Hansung Kim
a06b2dd20e sgemm_wg: Cleanup & proper unroll 2024-02-28 21:17:42 -08:00
Hansung Kim
46f242e520 sgemm_wg: Constantify BM/BN/BK/TM, computationally set gridsize and TB/core 2024-02-27 22:23:25 -08:00
Hansung Kim
27646bb507 sgemm_wg: Implement multiple C per thread with sliding A/B blocks 2024-02-27 22:06:01 -08:00
Hansung Kim
f1e7407d3a sgemm_wg: Run multiple threadblock per core 2024-02-27 15:44:04 -08:00