golang如何实现静态变量的效果
golang超时等待

任务队列machinery用法

妙音 posted @ 2021年5月01日 09:28 in golang , 1786 阅读
 

 描述

 
go实现的基于消息中间件的异步任务队列, 下面是学习笔记
 

使用概述

 
步骤1: 创建server，配置参数、注册task。(此处server只是个配置作用, 并不是单独的server进程)
 
步骤2: 启动worker
 
步骤3: 发送task
 
与celery的用法是完全一致的
 
 

创建server

 
func startServer() (*machinery.Server, error) {
cnf := &config.Config{
Broker:          "amqp://guest:guest@localhost:5672/",
DefaultQueue:    "machinery_tasks",
ResultBackend:   "amqp://guest:guest@localhost:5672/",
ResultsExpireIn: 3600,  //任务有效期
AMQP: &config.AMQPConfig{
Exchange:      "machinery_exchange",
ExchangeType:  "direct",
BindingKey:    "machinery_task",
PrefetchCount: 3,   //限定消费能力
},
}

// Create server instance
broker := amqpbroker.New(cnf)
backend := amqpbackend.New(cnf)
lock := eagerlock.New()     //任务锁
server := machinery.NewServer(cnf, broker, backend, lock)

// Register tasks
tasks := map[string]interface{}{
"add":               exampletasks.Add,
"multiply":          exampletasks.Multiply,
"sum_ints":          exampletasks.SumInts,
"sum_floats":        exampletasks.SumFloats,
"concat":            exampletasks.Concat,
"split":             exampletasks.Split,
"panic_task":        exampletasks.PanicTask,
"long_running_task": exampletasks.LongRunningTask,
}

return server, server.RegisterTasks(tasks)
}
 

创建worker

 
创建worker, 之后就可以启动了
 
func worker() error {
    //消费者的标记
consumerTag := "machinery_worker"

server, err := startServer()
if err != nil {
return err
}

    //第二个参数并发数, 0表示不限制
worker := server.NewWorker(consumerTag, 0)

    //钩子函数
errorhandler := func(err error) {}
pretaskhandler := func(signature *tasks.Signature) {}
posttaskhandler := func(signature *tasks.Signature) {}

worker.SetPostTaskHandler(posttaskhandler)
worker.SetErrorHandler(errorhandler)
worker.SetPreTaskHandler(pretaskhandler)
return worker.Launch()
}
 
启动结果
 
INFO: 2021/05/01 08:28:27 worker.go:58 Launching a worker with the following settings:
INFO: 2021/05/01 08:28:27 worker.go:59 - Broker: amqp://192.168.120.101:5672
INFO: 2021/05/01 08:28:27 worker.go:61 - DefaultQueue: machinery_tasks
INFO: 2021/05/01 08:28:27 worker.go:65 - ResultBackend: amqp://192.168.120.101:5672
INFO: 2021/05/01 08:28:27 worker.go:67 - AMQP: machinery_exchange
INFO: 2021/05/01 08:28:27 worker.go:68   - Exchange: machinery_exchange
INFO: 2021/05/01 08:28:27 worker.go:69   - ExchangeType: direct
INFO: 2021/05/01 08:28:27 worker.go:70   - BindingKey: machinery_task
INFO: 2021/05/01 08:28:27 worker.go:71   - PrefetchCount: 0
INFO: 2021/05/01 08:28:27 amqp.go:96 [*] Waiting for messages. To exit press CTRL+C
 

发送任务

 
server, _ := startServer()

signature := &tasks.Signature{
    Name: "add",
    Args: []tasks.Arg{
        {
            Type:  "int64",
            Value: 1,
        },
        {
            Type:  "int64",
            Value: 1,
        },
    },
}
asyncResult, _ := server.SendTask(signature)
fmt.Println(asyncResult.Get(time.Millisecond * 5))  //等待间隔，理论上是越小越好

//asyncResult.GetWithTimeout(time.Second*120, time.Millisecond * 5)   //第一个参数才是timeout
 

总结

 
以上就是machinery的基本用法,与celery基本一样, 更详细内容参考官方文档
 
 
 
Small_feed 评论 (38)
1
[回复]
Avatar_small
Imamia Quran Academy 说:
2023年7月23日 06:03

Nice blog. I enjoyed reading your articles. This is truly a great read for me. I am from Imamia Quran Academy. Our Online Shia Quran Academy is a comprehensive institution with full fledged facilities regarding Shia Quran Learning. Shia Online Learning more efficiently saves time and money spent over conveyance and physical going to any conventional Shia Quran Institute.

 

2
[回复]
Avatar_small
안전토토사이트 说:
2023年8月02日 03:50

I know your aptitude on this. I should say we ought to have an online discourse on this. Composing just remarks will close the talk straight away! What's more, will confine the advantages from this data.

3
[回复]
Avatar_small
Imamia Quran Academy 说:
2024年1月18日 08:30

Online Shia Quran Academy is an institute for Quran Education. They have trained teaching staff along with renowned Islamic Scholars for a better understanding of the Quran. Shia Quran Academy is an Online Ahle Tashi Institute that has all the features of traditional madrasahs including the teaching of an authentic understanding of the Quran. Additionally, Shia Quran Academy Online provides all teaching by certified professional teachers. Thus, joining Quran Academy will be suitable and beneficial for every learner. It is very difficult to find a good Online Shia Quran Center with Shia Teachers abroad except in Muslim or especially Ahle Tashi majority countries. Imamia Quran Center connects students virtually from all over the world including countries with less or no Ahle Tashi population or Shia Quran Centers. Our Quran Academy is a comprehensive institution with full fledged facilities regarding Shia Quran Learning. Ahle Tashi Quran student is free to choose the timings of classes, lecturers and tutors according to their feasibility and availability to Learn Shia Quran. Online learning more efficiently saves time and money spent over conveyance and physical going to any conventional Shia Quran Institute. Online Shia Madrasa selects highly qualified Quran teachers, keeping in mind the ages of kids and adults, who teach kids and adults Quranic education as well as their beliefs, spirituality and worldly life. The Shia Quran Madrasa Online is a secure place for kids and adults to learn and memorize the Quran. They teach the translation and interpretation of the Holy Quran under the guidance of expert Quranic teachers. Our Shia Quran Madrasa is second to none in providing education to Ahle Tashi women’s. So our center has selected Ahle Tashi Female Quran teacher with higher education from Madrasas. Online Shia Quran Madrasa is one of the best academies providing its services all over the world including USA, UK, Canada, Germany, France and Australia. Shia Quran Academy, a leading Online Shia Academy in the USA, offers exceptional virtual services that are accessible to anyone worldwide.

4
[回复]
Avatar_small
Top SEO 说:
2024年3月29日 16:47

Great job for publishing such a beneficial web site. Your web log isn’t only useful but it is additionally really creative too. mas informacion

5
[回复]
Avatar_small
Top SEO 说:
2024年4月01日 14:46 I read that Post and got it fine and informative. Please share more like that... online nursing assignment help in australia
6
[回复]
Avatar_small
Top SEO 说:
2024年4月01日 14:58

The article posted was very informative and useful. You people are doing a great job. Keep going. istana777

7
[回复]
Avatar_small
Top SEO 说:
2024年4月04日 01:48 it's really cool blog. Linking is very useful thing.you have really helped lock 101
8
[回复]
Avatar_small
Top SEO 说:
2024年4月05日 15:07

Hi there, I found your blog via Google while searching for such kinda informative post and your post looks very interesting for me pijat panggilan gading serpong

9
[回复]
Avatar_small
Top SEO 说:
2024年4月07日 14:30

Took me time to read all the comments, but I really enjoyed the article. It proved to be Very helpful to me and I am sure to all the commenters here! It’s always nice when you can not only be informed, but also entertained! Denticore

10
[回复]
Avatar_small
Top SEO 说:
2024年4月07日 14:31

I am a new user of this site so here i saw multiple articles and posts posted by this site,I curious more interest in some of them hope you will give more information on this topics in your next articles. Free SHEIN Voucher Codes

11
[回复]
Avatar_small
Top SEO 说:
2024年4月07日 14:33

Piala88 adalah link situs judi slot online gacor maxwin terbaik dan terpercaya 2024 Situs Slot Online

12
[回复]
Avatar_small
sa 说:
2024年4月09日 00:34 I really appreciate the kind of topics you post here. Thanks for sharing us a great information that is actually helpful. Good day! Over 3.5 goals
13
[回复]
Avatar_small
sa 说:
2024年4月09日 00:37

I found that site very usefull and this survey is very cirious, I ' ve never seen a blog that demand a survey for this actions, very curious... 666 correct score

14
[回复]
Avatar_small
sa 说:
2024年4月09日 00:42

Very good points you wrote here..Great stuff...I think you've made some truly interesting points.Keep up the good work. statarea

15
[回复]
Avatar_small
Top SEO 说:
2024年4月10日 04:00

Very awesome!!! When I seek for this I found this website at the top of all blogs in search engine. jual toto

16
[回复]
Avatar_small
Top SEO 说:
2024年4月10日 04:05

This was incredibly an exquisite implementation of your ideas slot

17
[回复]
Avatar_small
Top SEO 说:
2024年4月12日 17:38 Very informative post! There is a lot of information here that can help any business get started with a successful social networking campaign. free trial vps no credit card
18
[回复]
Avatar_small
Top SEO 说:
2024年4月13日 15:47

Very awesome!!! When I seek for this I found this website at the top of all blogs in search engine. oesv four roses

19
[回复]
Avatar_small
sa 说:
2024年4月15日 15:31

It was a very good post indeed. I thoroughly enjoyed reading it in my lunch time. Will surely come and visit this blog more often. Thanks for sharing. Lowongan Kerja Terbaru

20
[回复]
Avatar_small
sa 说:
2024年4月15日 17:41

Great article Lot's of information to Read...Great Man Keep Posting and update to People..Thanks Animeindo

21
[回复]
Avatar_small
sa 说:
2024年4月15日 17:44

Very nice article, I enjoyed reading your post, very nice share, I want to twit this to my followers. Thanks!. บ้านซีรี่ย์

22
[回复]
Avatar_small
sa 说:
2024年4月15日 17:47

I really thank you for the valuable info on this great subject and look forward to more great posts Samehadaku

23
[回复]
Avatar_small
sa 说:
2024年4月15日 17:51

Hi! This is my first visit to your blog! We are a team of volunteers and new initiatives in the same niche. Blog gave us useful information to work. You have done an amazing job! DramaQu

24
[回复]
Avatar_small
sa 说:
2024年4月15日 17:54

This is such a great resource that you are providing and you give it away for free. Drakor id

25
[回复]
Avatar_small
sa 说:
2024年4月15日 17:58

Hi, I log on to your new stuff like every week. Your humoristic style is witty, keep it up Drakorindo

26
[回复]
Avatar_small
sa 说:
2024年4月15日 18:03

I wanted to thank you for this great read!! I definitely enjoying every little bit of it I have you bookmarked to check out new stuff you post. โอเวอร์ ซีรี่ย์

27
[回复]
Avatar_small
sa 说:
2024年4月15日 18:06

This blog is so nice to me. I will keep on coming here again and again. Visit my link as well.. KissAnime

28
[回复]
Avatar_small
sa 说:
2024年4月15日 18:10

Nice post! This is a very nice blog that I will definitively come back to more times this year! Thanks for informative post. AnimeKisa

29
[回复]
Avatar_small
sa 说:
2024年4月19日 05:48

I think this is an informative post and it is very useful and knowledgeable. therefore, I would like to thank you for the efforts you have made in writing this article. Affordable Wallpaper Installation UAE

30
[回复]
Avatar_small
sa 说:
2024年4月19日 05:54

Thanks for the best blog. it was very useful for me.keep sharing such ideas in the future as well. upholstery cleaning newcastle

31
[回复]
Avatar_small
sa 说:
2024年4月20日 14:29

Its as if you had a great grasp on the subject matter, but you forgot to include your readers. Perhaps you should think about this from more than one angle. pijat panggilan karawaci

32
[回复]
Avatar_small
sa 说:
2024年4月20日 14:35

If you are looking for more information about flat rate locksmith Las Vegas check that right away. kampung inggris semarang

33
[回复]
Avatar_small
sa 说:
2024年4月20日 19:12 The article posted was very informative and useful. You people are doing a great job. Keep going. windows 12 iso file download
34
[回复]
Avatar_small
sa 说:
2024年4月23日 03:23

Very efficiently written information. It will be beneficial to anybody who utilizes it, including me. Keep up the good work. For sure i will check out more posts. This site seems to get a good amount of visitors. Vivamax Sub Indo

35
[回复]
Avatar_small
sa 说:
2024年4月24日 21:30 I am hoping the same best effort from you in the future as well. In fact your creative writing skills has inspired me. pahala4d
36
[回复]
Avatar_small
sa 说:
2024年4月24日 21:36

Wow i can say that this is another great article as expected of this blog.Bookmarked this site.. pahala4d

37
[回复]
Avatar_small
Top SEO 说:
2024年4月25日 13:37 Very informative post ! There is a lot of information here that can help any business get started with a successful social networking campaign ! etrebelle
38
[回复]
Avatar_small
sa 说:
2024年4月26日 02:55 Эксклюзивные турниры только на VAVADA. Приветственный бонус до 1 000 $ + 100 фриспинов. Играйте на фишки, а выигрывайте реальные деньги. вавада официальный сайт

登录 *


loading captcha image...
(输入验证码)
or Ctrl+Enter