University of Texas at Austin

UTEXAS's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Articles

atutej 

submitted a paper to Daily Papers 3 days ago

EntRGi: Entropy Aware Reward Guidance for Diffusion Language Models

Paper • 2602.05000 • Published 4 days ago • 1

Sunny111 

posted an update 23 days ago

view post

Post

1610

Are you familiar with reverse residual connections or looping in language models?

Excited to share my Looped-GPT blog post and codebase 🚀
https://github.com/sanyalsunny111/Looped-GPT

TL;DR: looping during pre-training improves generalization.

Plot shows GPT2 LMs pre-trained with 15.73B OWT tokens

P.S. This is my first post here — I have ~4 followers and zero expectations for reach 😄

See translation

• 
• 

• 
• 
• 
• 3 replies

·

🧠

6

6

👍

3

3

+

Reply

hychiang 

authored a paper 2 months ago

UniQL: Unified Quantization and Low-rank Compression for Adaptive Edge LLMs

Paper • 2512.03383 • Published Dec 3, 2025 • 5

abao 

authored a paper 6 months ago

Concentration of Measure for Distributions Generated via Diffusion Models

Paper • 2501.07741 • Published Jan 13, 2025

fcyin 

authored a paper 8 months ago

LongProc: Benchmarking Long-Context Language Models on Long Procedural Generation

Paper • 2501.05414 • Published Jan 9, 2025 • 2

fcyin 

authored a paper 9 months ago

ChartMuseum: Testing Visual Reasoning Capabilities of Large Vision-Language Models

Paper • 2505.13444 • Published May 19, 2025 • 17

lytang 

authored a paper 9 months ago

ChartMuseum: Testing Visual Reasoning Capabilities of Large Vision-Language Models

Paper • 2505.13444 • Published May 19, 2025 • 17

hychiang 

authored 4 papers 10 months ago

Quamba2: A Robust and Scalable Post-training Quantization Framework for Selective State Space Models

Paper • 2503.22879 • Published Mar 28, 2025 • 9

Quamba: A Post-Training Quantization Recipe for Selective State Space Models

Paper • 2410.13229 • Published Oct 17, 2024 • 1

Efficient Low-rank Backpropagation for Vision Transformer Adaptation

Paper • 2309.15275 • Published Sep 26, 2023 • 1

MobileTL: On-device Transfer Learning with Inverted Residual Blocks

Paper • 2212.03246 • Published Dec 5, 2022 • 1

joydeep-b 

authored a paper about 1 year ago

PhD Knowledge Not Required: A Reasoning Challenge for Large Language Models

Paper • 2502.01584 • Published Feb 3, 2025 • 9

peihaowang 

authored a paper about 1 year ago

Rethinking Addressing in Language Models via Contexualized Equivariant Positional Encoding

Paper • 2501.00712 • Published Jan 1, 2025 • 6

fcyin 

authored a paper over 1 year ago

To CoT or not to CoT? Chain-of-thought helps mainly on math and symbolic reasoning

Paper • 2409.12183 • Published Sep 18, 2024 • 39

lytang 

authored a paper almost 2 years ago

MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documents

Paper • 2404.10774 • Published Apr 16, 2024 • 6

Sunny111 

authored a paper almost 2 years ago

Pre-training Small Base LMs with Fewer Tokens

Paper • 2404.08634 • Published Apr 12, 2024 • 36

advaitp 

authored a paper almost 2 years ago

PAC Generalization via Invariant Representations

Paper • 2205.15196 • Published May 30, 2022

lytang 

authored a paper almost 2 years ago

TofuEval: Evaluating Hallucinations of LLMs on Topic-Focused Dialogue Summarization

Paper • 2402.13249 • Published Feb 20, 2024 • 15

peihaowang 

authored 2 papers almost 2 years ago

Enhancing NeRF akin to Enhancing LLMs: Generalizable NeRF Transformer with Mixture-of-View-Experts

Paper • 2308.11793 • Published Aug 22, 2023 • 2

SteinDreamer: Variance Reduction for Text-to-3D Score Distillation via Stein Identity

Paper • 2401.00604 • Published Dec 31, 2023 • 6