# arXiv — Zapi reference > Searches an open-access repository of scientific preprints and returns paper metadata. **Base URL:** `https://api.zpi.web.id` **Auth:** Send `x-api-key: YOUR_KEY` header on every request. Get a free key at https://zpi.web.id/dashboard/keys. **Response envelope:** `{ status, message, content }` **Rate limit:** 60 req/min on free tier. **Related:** - Detail page: https://zpi.web.id/api/search-tools/arxiv - Endpoint catalog: https://zpi.web.id/category/search-tools - Concise index: https://zpi.web.id/llms.txt - Full reference: https://zpi.web.id/llms-full.txt --- ## arXiv **Category:** search-tools · **Slug:** `arxiv` **Detail page:** https://zpi.web.id/api/search-tools/arxiv Searches an open-access repository of scientific preprints and returns paper metadata. **Tags:** search, academic, papers ### Search Returns matching preprints with titles, authors, abstracts, and links for a query. - **Method:** `GET` - **Endpoint:** `https://api.zpi.web.id/v1/search-tools:arxiv/search` - **Cache TTL:** 300s **Parameters:** | Name | Type | Location | Required | Description | |------|------|----------|----------|-------------| | `query` | string | query | yes | Search keyword | | `count` | number | query | no | Results per page 1-30 (default 10) | | `page` | number | query | no | Result page (default 1, max 50) | **cURL:** ```bash curl "https://api.zpi.web.id/v1/search-tools:arxiv/search?query=transformer&count=10&page=1" \ -H "x-api-key: YOUR_API_KEY" ``` **JavaScript / TypeScript:** ```javascript const res = await fetch("https://api.zpi.web.id/v1/search-tools:arxiv/search?query=transformer&count=10&page=1", { headers: { "x-api-key": process.env.ZAPI_KEY } }); const data = await res.json(); ``` **Python:** ```python import requests r = requests.get("https://api.zpi.web.id/v1/search-tools:arxiv/search?query=transformer&count=10&page=1", headers={"x-api-key": "YOUR_API_KEY"}) data = r.json() ``` **Example response:** ```json { "page": 1, "count": 5, "items": [ { "url": "http://arxiv.org/abs/2201.00978v1", "title": "PyramidTNT: Improved Transformer-in-Transformer Baselines with Pyramid Architecture", "pdfUrl": "https://arxiv.org/pdf/2201.00978v1", "source": "arxiv.org", "authors": [ "Kai Han", "Jianyuan Guo", "Yehui Tang", "Yunhe Wang" ], "summary": "Transformer networks have achieved great progress for computer vision tasks. Transformer-in-Transformer (TNT) architecture utilizes inner transformer and outer transformer to extract both local and global representations. In this work, we present new TNT baselines by introducing two advanced designs: 1) pyramid architecture, and 2) convolutional stem. The new \"PyramidTNT\" significantly improves the original TNT by establishing hierarchical representations. PyramidTNT achieves better performances than the previous state-of-the-art vision transformers such as Swin Transformer. We hope this new baseline will be helpful to the further research and application of vision transformer. Code will be available at https://github.com/huawei-noah/CV-Backbones/tree/master/tnt_pytorch.", "publishedAt": "2022-01-04T04:56:57Z" }, { "url": "http://arxiv.org/abs/2104.11502v1", "title": "Learning to Cluster Faces via Transformer", "pdfUrl": "https://arxiv.org/pdf/2104.11502v1", "source": "arxiv.org", "authors": [ "Jinxing Ye", "Xioajiang Peng", "Baigui Sun", "Kai Wang", "Xiuyu Sun", "Hao Li", "Hanqing Wu" ], "summary": "Face clustering is a useful tool for applications like automatic face annotation and retrieval. The main challenge is that it is difficult to cluster images from the same identity with different face poses, occlusions, and image quality. Traditional clustering methods usually ignore the relationship between individual images and their neighbors which may contain useful context information. In this paper, we repurpose the well-known Transformer and introduce a Face Transformer for supervised face clustering. In Face Transformer, we decompose the face clustering into two steps: relation encoding and linkage predicting. Specifically, given a face image, a \\textbf{relation encoder} module aggregates local context information from its neighbors and a \\textbf{linkage predictor} module judges whether a pair of images belong to the same cluster or not. In the local linkage graph view, Face Transformer can generate more robust node and edge representations compared to existing methods. Experiments on both MS-Celeb-1M and DeepFashion show that our method achieves state-of-the-art performance, e.g., 91.12\\% in pairwise F-score on MS-Celeb-1M.", "publishedAt": "2021-04-23T09:43:36Z" }, { "url": "http://arxiv.org/abs/2404.05657v1", "title": "MLP Can Be A Good Transformer Learner", "pdfUrl": "https://arxiv.org/pdf/2404.05657v1", "source": "arxiv.org", "authors": [ "Sihao Lin", "Pumeng Lyu", "Dongrui Liu", "Tao Tang", "Xiaodan Liang", "Andy Song", "Xiaojun Chang" ], "summary": "Self-attention mechanism is the key of the Transformer but often criticized for its computation demands. Previous token pruning works motivate their methods from the view of computation redundancy but still need to load the full network and require same memory costs. This paper introduces a novel strategy that simplifies vision transformers and reduces computational load through the selective removal of non-essential attention layers, guided by entropy considerations. We identify that regarding the attention layer in bottom blocks, their subsequent MLP layers, i.e. two feed-forward layers, can elicit the same entropy quantity. Meanwhile, the accompanied MLPs are under-exploited since they exhibit smaller feature entropy compared to those MLPs in the top blocks. Therefore, we propose to integrate the uninformative attention layers into their subsequent counterparts by degenerating them into identical mapping, yielding only MLP in certain transformer blocks. Experimental results on ImageNet-1k show that the proposed method can remove 40% attention layer of DeiT-B, improving throughput and memory bound without performance compromise. Code is available at https://github.com/sihaoevery/lambda_vit.", "publishedAt": "2024-04-08T16:40:15Z" }, { "url": "http://arxiv.org/abs/1809.04281v3", "title": "Music Transformer", "pdfUrl": "https://arxiv.org/pdf/1809.04281v3", "source": "arxiv.org", "authors": [ "Cheng-Zhi Anna Huang", "Ashish Vaswani", "Jakob Uszkoreit", "Noam Shazeer", "Ian Simon", "Curtis Hawthorne", "Andrew M. Dai", "Matthew D. Hoffman", "Monica Dinculescu", "Douglas Eck" ], "summary": "Music relies heavily on repetition to build structure and meaning. Self-reference occurs on multiple timescales, from motifs to phrases to reusing of entire sections of music, such as in pieces with ABA structure. The Transformer (Vaswani et al., 2017), a sequence model based on self-attention, has achieved compelling results in many generation tasks that require maintaining long-range coherence. This suggests that self-attention might also be well-suited to modeling music. In musical composition and performance, however, relative timing is critically important. Existing approaches for representing relative positional information in the Transformer modulate attention based on pairwise distance (Shaw et al., 2018). This is impractical for long sequences such as musical compositions since their memory complexity for intermediate relative information is quadratic in the sequence length. We propose an algorithm that reduces their intermediate memory requirement to linear in the sequence length. This enables us to demonstrate that a Transformer with our modified relative attention mechanism can generate minute-long compositions (thousands of steps, four times the length modeled in Oore et al., 2018) with compelling structure, generate continuations that coherently elaborate on a given motif, and in a seq2seq setup generate accompaniments conditioned on melodies. We evaluate the Transformer with our relative attention mechanism on two datasets, JSB Chorales and Piano-e-Competition, and obtain state-of-the-art results on the latter.", "publishedAt": "2018-09-12T07:15:26Z" }, { "url": "http://arxiv.org/abs/2212.14538v2", "title": "Transformer in Transformer as Backbone for Deep Reinforcement Learning", "pdfUrl": "https://arxiv.org/pdf/2212.14538v2", "source": "arxiv.org", "authors": [ "Hangyu Mao", "Rui Zhao", "Hao Chen", "Jianye Hao", "Yiqun Chen", "Dong Li", "Junge Zhang", "Zhen Xiao" ], "summary": "Designing better deep networks and better reinforcement learning (RL) algorithms are both important for deep RL. This work focuses on the former. Previous methods build the network with several modules like CNN, LSTM and Attention. Recent methods combine the Transformer with these modules for better performance. However, it requires tedious optimization skills to train a network composed of mixed modules, making these methods inconvenient to be used in practice. In this paper, we propose to design \\emph{pure Transformer-based networks} for deep RL, aiming at providing off-the-shelf backbones for both the online and offline settings. Specifically, the Transformer in Transformer (TIT) backbone is proposed, which cascades two Transformers in a very natural way: the inner one is used to process a single observation, while the outer one is responsible for processing the observation history; combining both is expected to extract spatial-temporal representations for good decision-making. Experiments show that TIT can achieve satisfactory performance in different settings consistently.", "publishedAt": "2022-12-30T03:50:38Z" } ], "total": 174551, "hasMore": true, "nextPage": 2 } ``` --- _Generated: 2026-08-02T14:28:09.528Z_