标签： 苏州喝茶服务vx

The Heart of the Machine & ArXiv Weekly

Participation: Chu Hang, Luo Ruotian, Mei Hongyuan

This week’s important papers include the first research on the world model of Yann LeCun, a Turing Prize winner, and MusicGen, a Meta open source text-generated music model.

Directory:

Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture

Adversarial Example Does Good: Preventing Painting Imitation from Diffusion Models via Adversarial Examples

Disentangling Writer and Character Styles for Handwriting Generation

INSTRUCTEVAL: Towards Holistic Evaluation of Instruction-Tuned Large Language Models

Reverse Engineering Self-Supervised Learning

VideoComposer: Compositional Video Synthesis with Motion Controllability

Simple and Controllable Music Generation

Arxiv Weekly Radio Station: More Selected Papers of NLP, CV and ML (with Audio)

Paper 1: self-supervised learning from images with a joint-embedding predictive architecture

Authors: Mahmoud Assran et al.

Paper link: https://arxiv.org/pdf/2301.08243.pdf

Abstract: Let AI learn and reason like human beings, which is an important step for artificial intelligence to move towards human intelligence. Yann LeCun, winner of Turing Prize, once proposed a solution of self-monitoring and world model, and now he finally has the first real visual model-I-JEPA. As shown in the following figure, I-JEPA uses a single context block to predict the representations of various target blocks originating from the same image.

Recommendation: The first study of LeCun world model is coming: self-monitoring vision, learning and reasoning like human beings, which is open source.

Paper 2: Adversarial example does good: preventing painting from different models via Adversarial examples.

Authors: Chumeng Liang et al

Paper link: https://arxiv.org/abs/2302.04578

This paper introduces a paper included in ICML 2023 Oral, which was jointly completed by the Shanghai Key Laboratory of Scalable Computing and Systems, new york University and Queen’s University of Belfast. The joint works of this thesis are Liang Chumeng, who is about to study for a doctorate at the University of Southern California, and Wu Xiaoyu, a graduate student at Shanghai Jiaotong University.

Recommendation: quietly add pixel-level watermark to the picture: the method to prevent AI from "copying" works of art has been found.

Paper 3: Disentangling Writer and Character Styles for Writing Generation

Authors: Gang Dai et al.

Paper link: https://arxiv.org/abs/2303.14736

In this paper, researchers from South China University of Technology, National University of Singapore, Hong Kong Polytechnic University and Pazhou Laboratory jointly put forward an interesting handwritten character generation method, which can copy the user’s writing style only by providing a few reference samples, and then generate arbitrary characters that conform to this style.

Recommendation: AI, which can imitate handwriting, creates a unique font for you and is selected as CVPR 2023.

Paper 4: Instructive Eval: Towards Holistic Evaluation of Instruction-Tuned Large Language Models

Authors: Yew Ken Chia et al.

Paper link: https://arxiv.org/abs/2306.04757

Abstract: Over the years, what is the performance of instruction tuning large language model? This study puts forward a brand-new evaluation suite, which comprehensively evaluates them in solving problems, writing and aligning human values, and the results may exceed your expectations. The researchers provide an overall overview of the open source instruction model in Table 3 below.

Recommendation: for four years, the basic open source model has not really improved, and the evaluation of the instruction tuning model is amazing.

Paper 5: reverse engineering self-supervised learning

Authors: Ido Ben-Shaul et al.

Paper link: https://arxiv.org/abs/2305.15614v2

Self-supervised learning can use the unsupervised data of auxiliary tasks to mine its own supervision information, and train the network through this constructed supervision information, so as to learn valuable representations for downstream tasks. Recently, many researchers, including Yann LeCun, winner of Turing Prize, published a study, claiming that self-supervised learning was reverse-engineered, so that we could understand the internal behavior of its training process.

In order to intuitively understand SSL training, Figure 1 below shows the embedding space of training samples of the network through UMAP visualization, which includes the situation before and after training and is divided into different levels.

Recommendation: New research achievement of Yann LeCun team: For self-supervised learning reverse engineering, the original clustering is realized in this way.

Paper 6: video composer: comprehensive video synthesis with motion controllability

Authors: Xiang Wang et al

Paper link: https://arxiv.org/abs/2306.02018

Abstract: In the field of AI painting, Composer proposed by Ali and ControlNet proposed by Stanford led the theoretical development of controllable image generation. However, the exploration of controllable video generation in the industry is still in a relatively blank state. Compared with image generation, controllable video is more complicated, because besides the spatial controllability of video content, it also needs to meet the controllability of time dimension. Based on this, the research teams of Alibaba and Ant Group took the lead in making an attempt and put forward VideoComposer, which realizes the controllability of video in both time and space through combined generation paradigm.

In this study, the performance of VideoComposer is directly tested on nine different classic tasks, and satisfactory results are obtained, which proves the universality of VideoComposer.

Recommendation: Video generation with controllable time and space has come into reality, and the new work VideoComposer of Ali’s big model is on fire.

Paper 7: simple and controllable music generation

Authors: Jade Copet et al.

Paper link: https://arxiv.org/pdf/2306.05284.pdf

Abstract: At the beginning of the year, Google launched MusicLM, a big model of music generation, and the effect was very good. Some people say that this is more important than the ChatGPT of the fire, which almost solves the problem of music generation. Recently, Meta also launched its own text music generation model, MusicGen, which is free for non-commercial use.

Enter the first two sentences in the lyrics of Jay Chou’s "Qi Li Xiang" as follows: "The sparrow outside the window talks on the telephone pole, and you say this sentence is very summer-like" (in Chinese).

Recommendation: Meta open source text generates a big music model, and we tried it with the lyrics of Qilixiang.

ArXiv Weekly Radiostation

Machine Heart, together with ArXiv Weekly Radiostation initiated by Chu Hang, Luo Ruotian and Mei Hongyuan, selected more important papers this week, including 10 selected papers in NLP, CV and ML fields, and provided an audio abstract introduction. Details are as follows:

The 10 NLP selected papers this week are:

1. Can Large Language Models Infer Causation from Correlation? . (from Bernhard Sch?lkopf)

2. Developing Speech Processing Pipelines for Police Accountability. (from Dan Jurafsky)

3. SqueezeLLM: Dense-and-Sparse Quantization. (from Michael W. Mahoney, Kurt Keutzer)

4. Morphosyntactic probing of multilingual BERT models. (from Noah A. Smith)

5. ChatGPT for Us: Preserving Data Privacy in ChatGPT via Dialogue Text Ambiguation to Expand Mental Health Care Delivery. (from Kai-Wei Chang, Majid Sarrafzadeh)

6. Language models are not naysayers: An analysis of language models on negation benchmarks. (from Timothy Baldwin)

7. Modality Adaption or Regularization? A Case Study on End-to-End Speech Translation. (from Jingbo Zhu)

8. Xiezhi: An Ever-Updating Benchmark for Holistic Domain Knowledge Evaluation. (from Rui Xu)

9. Word sense extension. (from Lei Yu)

10. Instruction Tuned Models are Quick Learners. (from Chitta Baral)

The top 10 CV selected papers this week are:

1. Multi-Modal Classifiers for Open-Vocabulary Object Detection. (from Andrew Zisserman)

2. AVIS: Autonomous Visual Information Seeking with Large Language Models. (from Kai-Wei Chang, Cordelia Schmid)

3. SMC-UDA: Structure-Modal Constraint for Unsupervised Cross-Domain Renal Segmentation. (from Rama Chellappa, Xinbo Gao)

4. Aladdin: Zero-Shot Hallucination of Stylized 3D Assets from Abstract Scene Descriptions. (from Leonidas Guibas)

5. Adding 3D Geometry Control to Diffusion Models. (from Alan Yuille)

6. Compositor: Bottom-up Clustering and Compositing for Robust Part and Object Segmentation. (from Alan Yuille)

7. Teaching AI to Teach: Leveraging Limited Human Salience Data Into Unlimited Saliency-Based Training. (from Kevin Bowyer)

8. Instant Multi-View Head Capture through Learnable Registration. (from Michael J. Black)

9. FlowFormer: A Transformer Architecture and Its Masked Cost Volume Autoencoding for Optical Flow. (from Xiaogang Wang)

10. MOFI: Learning Image Representations from Noisy Entity Annotated Images. (from Jon Shlens)

The 10 ML selected papers this week are:

1. A Comprehensive Survey on Applications of Transformers for Deep Learning Tasks. (from Witold Pedrycz)

2. Inductive Linear Probing for Few-shot Node Classification. (from Huan Liu)

3. Virtual Node Tuning for Few-shot Node Classification. (from Huan Liu)

4. Understanding How Consistency Works in Federated Learning via Stage-wise Relaxed Initialization. (from Dacheng Tao)

5. Extending Kernel PCA through Dualization: Sparsity, Robustness and Fast Algorithms. (from Johan A. K. Suykens)

6. Variational Positive-incentive Noise: How Noise Benefits Models. (from Xuelong Li)

7. Privacy Preserving Bayesian Federated Learning in Heterogeneous Settings. (from Joydeep Ghosh)

8. One-for-All: Generalized LoRA for Parameter-Efficient Fine-tuning. (from Eric Xing)

9. Identification of Nonlinear Latent Hierarchical Models. (from Eric Xing)

10. Composing Efficient, Robust Tests for Policy Selection. (from Peter Stone)

? THE END

Please contact Ben WeChat official account for authorization.

Contribute or seek reports: content@jiqizhixin.com.

Original title: "7 Papers & Radios | LeCun World Model is the first attempt; Meta open source text music generation model "

Read the original text

　　Seimi Zhang, June 4 (Xinhua) Recently, the word "stall economy" has been completely popular, and the number of related Weibo topics has exceeded 600 million. Many places have set up vendors’ standard points to encourage the development of stall economy.

　　Set up vendors’ standard points in many places to develop stall economy

　　According to incomplete statistics, up to now, there are at least Shanghai, Jinan, Nanning, Zhengzhou, Nanjing, Chengdu, Hefei, Xiamen, Shaanxi, Liaoning, Jiangxi, Gansu, Changchun, Hangzhou, Changsha, Shijiazhuang, Nanning, Qingdao, Yichang, Huanggang, Deyang, Panzhihua, Guang ‘an, Nanchong, Ziyang.

　　Data map: stall economy. Zhongxin jingwei photo

　　Ying Xiwen, head of the macro-regional research team of the People’s Bank of China think tank, pointed out in an interview with Zhongxin Jingwei client that the stall economy has always been a "gray zone" in China’s urban economy, and its existence has certain rationality, which has alleviated the employment pressure to a certain extent, promoted the development of the tertiary industry, and at the same time activated the market and stimulated economic development.

　　Zhang Zhixin, an associate professor at the School of Urban Economics and Public Administration of Capital University of Economics and Business, told the client of Zhongxin Jingwei that liberalizing the development of stall economy can meet people’s consumption demand, especially during the epidemic period, stall economy brings convenience to people’s shopping, and at the same time increases the fireworks in the city, which also meets the current requirements for epidemic prevention and control.

　　The first Shanghai Nightlife Festival was launched on June 6th.

　　On June 3rd, the press conference of Shanghai Municipal Government revealed that Shanghai will hold the first Shanghai Nightlife Festival from June 6th to June 30th. Create a new image of night Shanghai with fireworks, Shanghai flavor, fashion trend and international style.

　　In addition, recently, Shanghai Urban Management Law Enforcement Bureau formulated and issued the Guiding Opinions of Shanghai Urban Management Law Enforcement Bureau on Optimizing the Business Environment, and Shanghai will support the development of new consumption formats. Promote the economic development of the night market, cooperate with local governments and relevant administrative departments to scientifically set up the night market, guide the night market to implement the management subject and implement merchant autonomy. Support specialty stores to carry out "external placement" operation, and implement refined management of external placement time and placement scope.

　　Jinan proposes to develop "small store economy"

　　On June 2nd, Liu Yanqiu, director of Jinan Municipal Bureau of Commerce, said at the press conference held by Jinan Municipal Party Committee and Municipal Government that Jinan would rationally release the street stall economy, and vigorously develop the night economy, promote consumption transformation and upgrading, and increase jobs by upgrading the IP brand of the night economy, cultivating the theme blocks of the night economy, holding special activities of the night economy, and building the brand of the night economy and culture.

　　Jinan also proposed to develop "small store economy", optimize the access process of "small stores", shorten the time limit for examination and approval, and guide various formats to extend business hours; Support catering stores to increase snack categories and rest places to increase consumers’ stay time; Moderately allow businesses to make personalized shop signs, shop signs, beautiful Chen and street artists to sing, and increase the employment opportunities of urban residents.

　　Nanning makes it clear that minor violations of urban management laws and regulations will not be punished.

　　On June 2nd, the headquarters office of "Beautiful Nanning Clean, Smooth and Orderly Action" issued "Guiding Opinions on Doing a Good Job in Services such as Occupation Management, Road Market and Mobile Vendors", which came into effect on the 2nd and is valid until December 31st this year.

　　The "Opinions" clarify that in order to protect the economy, temporary stalls are allowed to be opened near residential concentrated areas to guide self-produced and self-sold farmers and mobile vendors to regulate their operations; Encourage the use of idle areas inside and outside the community, set up temporary stalls, and where conditions permit, set up the morning market and night market. The "Opinions" also make it clear that enterprises and operators will not be punished for minor violations of relevant laws and regulations on urban management due to their production and business activities. In principle, no booth fee, booth rent and other fees will be charged to operators and mobile vendors who occupy the roads in permitted areas.

　　Demonstrative zones of night economic agglomeration are arranged around Zhengzhou.

　　On June 2nd, Zhengzhou issued "Opinions on Implementing People-Centered Development Thought and Doing Better Work for the People", in which it was mentioned that each county (city, district) and development zone should rationally arrange one or two demonstration zones of "night goods, night shopping, night appreciation, night tour and night health" and hold one or three night economic theme activities. To carry out the selection of night economic activities in counties (cities, districts) and development zones, the municipal finance will reward the top three with 1 million yuan, 800,000 yuan and 500,000 yuan respectively.

　　On the evening of June 2, Zhengzhou Jiankang Road Night Market was very lively. Zhongxin jingwei photo

　　In addition, all counties (cities, districts) and development zones in Zhengzhou should clearly plan their distribution, implement management measures, make full use of public places such as squares and parks and idle land, and set up bazaars and characteristic flea markets according to the principles of fixed time, fixed place, fixed format, fixed expenses and fixed management.

　　Nanjing added 1,410 temporary outside stalls.

　　On May 1st, Nanjing Urban Management Bureau issued "Guiding Opinions on Doing a Good Job in Service Management of Temporary Outside Stalls during Epidemic Prevention", requiring that obvious signs should be set up in temporary outside areas, stalls should be numbered, business items, business hours and safety tips should be publicized, and garbage should be collected separately at the site.

　　On the basis of the existing 3,400 temporary stalls, Nanjing Urban Management Bureau added 134 temporary external stalls in the city this year. The area, scale and time period of setting up temporary external stalls in this opening need to be reviewed by the urban management departments of all districts. The urban management law enforcement department will resolutely investigate and deal with illegal acts such as occupying roads and unlicensed mobile stalls.

　　Chengdu plans a more elaborate stall policy version 2.0

　　On March 14th, Chengdu issued "Chengdu Urban Management Five Permits and One Persist in Coordinating Epidemic Prevention and Control to Help Economic Development". On the premise of ensuring safety, not occupying blind roads and fire exits, not infringing on the interests of others, and doing a good job in epidemic prevention and control, cleaning and sanitation, it is allowed to set up temporary stalls, allow street shops to operate outside the door, allow large shopping malls to carry out occupation promotion and allow mobile vendors to sell. As of May 28th, Chengdu has set up 2,230 temporary road stalls and stalls, allowing 17,147 temporary crossing points and 20,130 mobile vendors, increasing employment by more than 100,000 people.

　　According to the Chengdu Urban Management Committee, Chengdu is planning a more precise and precise version of the policy 2.0, so as to realize the organic unity of standardized and orderly occupation of roads, clean and tidy city environment, convenient and fast life for citizens, more active urban consumption and stronger market atmosphere.

　　Hefei stalls are divided into "forbidden areas" and "diversion areas"

　　The setting area of Hefei stalls is divided into "forbidden area" and "diversion area". Among them, the "forbidden area" refers to the main roads, window units, squares, bridges (including footbridges), underground passages, the periphery of office areas, the entrance and exit of the campus within 100 meters, and other areas where stalls are not allowed to be set up as stipulated by laws and regulations. In addition to the forbidden areas, the areas outside the forbidden areas shall be demarcated by the district governments and development zone management committees and announced to the public without affecting the lives of citizens and traffic, and shall be standardized and managed according to the standards.

　　There are 37 stalls in the "grooming area" to provide convenience for the public. In addition to 37 temporarily defined stalls, there are some seasonal or temporary convenience stalls in Hefei, mainly including temporary watermelon sales outlets, breakfast carts, kiosks and so on.

　　Xiamen has been trying out the "booth" since 2019.

　　Since June last year, the trial of "booth" has been carried out, and 50 "booth" of various types have been built in Xiamen, providing 1150 booths. In addition to the autonomy of business households, urban management and law enforcement departments also cooperate with relevant responsible units to do a good job in food safety and environmental sanitation management at these "stalls".

　　Xiamen Urban Management and Law Enforcement Bureau said that it will further communicate and coordinate with relevant departments, make full use of idle venues, roads with few cars, beaches, etc., and establish flea markets, gourmet streets, fruit markets, etc. in a time-limited manner to bring more mobile vendors into orderly management.

　　For the first time at the provincial level in Shaanxi Province, the "four permits" on the occupation of roads were put forward.

　　On May 27th, Shaanxi Province issued a notice, proposing that "street shops in urban areas should be allowed to operate without affecting pedestrian access and ensuring safety, large shopping malls should be allowed to occupy the road for promotion, temporary stalls should be opened in residential areas, and mobile vendors should be allowed to occupy the road for operation at a certain time and area". This is the first time at the provincial level in Shaanxi Province that the "four permits" on the occupation of roads have been put forward.

　　At the same time, Xi ‘an plans to set up 100 vegetable morning markets, 100 night market barbecue centralized management areas and 100 temporary food stall sites this year.

　　Spreading economic related topics into hot search professional households

　　Source: Weibo screenshot

　　In the past few days, Weibo topics such as # Street Economy # # Urban Management called vendors to set up stalls # # Street Cars # have been on the hot search list. As of 23: 30 on June 3, the reading volume of # Street Economy # Weibo topic has exceeded 630 million, with more than 100,000 discussions.

　　Source: Weibo User Comments Screenshot

　　Spread the economic fire all over the country, all over the network. Netizens have said: "It is suggested that every city should leave some places for stalls, not sneaking stalls but civilized stalls, which will not affect traffic and the environment, but also increase income." "Stalls, night markets, so fireworks, like it." "The stall is really convenient and affordable and gives the community a sense of life."

　　Source: Weibo User Comments Screenshot

　　At the same time, netizens have also given advice to the economic development of the stalls: "The bottom line of maintaining hygiene, exclusive areas and food safety should also be adhered to." "It is allowed to set up stalls, but it can’t be arbitrarily placed, and a new harmonious and win-win economic order will be established." "Don’t overdo it, don’t be across the board."

　　Expert: Letting go of the stall economy does not mean letting go of responsibility.

　　During the development of stall economy, it is inevitable to cause some urban management problems, such as sanitation and pollution, traffic congestion, noise disturbing people, insecure commodity quality and safety, social security and tax evasion.

　　The essay suggests taking this opportunity to solve the long-standing problem of standardizing stall economy in one fell swoop. The first is to register and manage the practitioners in the stall economy. The second is to limit the space and time of operation to avoid affecting traffic. The third is to strengthen the control of health pollution and establish an emergency management system for epidemic prevention. The fourth is to set up a service quality supervision mechanism to protect consumers’ rights and interests. The fifth is to improve management efficiency with the help of Internet thinking, such as online application, registration and tax filing.

　　Zhang Zhixin said that letting go of the stall economy does not mean letting go of the responsibility, nor does it mean giving up the law. In terms of food safety, environmental pollution and other aspects related to the vital interests of the people, urban law enforcement departments must investigate reports, investigate violations and enforce the law strictly. But at the same time, we should avoid overcorrection and one size fits all. (Zhongxin Jingwei APP)