Batch Queue Puns

Also it’s pretty annoying that although a recipe is checked, you still have to click on it. Why would that matter?

But for real I miss the queue. Helps me see what’s left, let’s me stop, pause, drag important images to the front, etc.

Or did it get put somewhere I can't find it?

Hi everyone,

Having clicked within the first minute I haven't made it to the first batch, and with the release of HL ALYX in just 6 days, I doubt that I have any chance to get the headset in time. For me it now says

Ships in 3 to 5 weeks.

Now I know that valve is not giving us the queue numbers but I think we can figure it out by ourselves or at least get a better estimate by comparing the order status with the exact time of the confirmation email. If you are using Gmail you get the exact time (to the second) by checking the email headers. You can do that by opening the confirmation email then clicking the 3 dots on the upper right corner and choosing "Show original" More information on how to do that on google support.

Received time:

There in the headers, you can find the exact received time and in my case, it's Mon, 9 March 2020 10:00:27 -0700 (PDT).

Solely by this info, we can infer that everyone receiving their confirmation before the second 27 will have their index shipped sooner than 3 to 5 weeks. Now the more information we have the more we can puzzle together what the expected shipping times will be.

I for one I wonder at what second is the confirmation email of those that already received their headset. That will give us a better clue into what second the second batch begins.

I will keep updating this post as we gather more info on the matter. If you want to participate in this survey all you have to do is write your order status together with the exact time you received your confirmation email. I think we can figure this out together cos this waiting game and uncertainty are hard.

Rough estimate for EU / US / ASIA queue times:

1. **First batch - Shipping.** (9 data points)
   From: Mon, 9 March 2020 09:59:50 -0700 ( PDT )
   To: Mon, 9 March 2020 10:00:27 -0700 ( PDT )
2. **Second batch - Ships in 3 - 5 weeks.** (33 data points)
   From: Mon, 9 March 2020 10:00:03 -0700 ( PDT )
   To: Mon, 9 March 2020 10:32:37 -0700 ( PDT )
3. **Third batch - Ships in 4 to 6 weeks.** (0 data points)
   Not enough info
4. **Fourth batch - Ships in 5 to 8 weeks.** ( 0 data points)
   Not enough info
5. ****Fifth ba

Looking for the simplest dirtiest queue I can use to run a lot of shell scripts one at a time.

Edit / clarification:

I have a bunch of cron jobs running. Need to serialize a portion of them to avoid race conditions. Right now I am doing: Crontab (abbrev syntax, which won't work. it's actually nastier but I'm on mobile now)

32 * * * * cat <<< 'export x=foo ; script1.sh' | batch

27 * * * * cat <<< 'export y=bar ; script2.sh' | batch

. ... Lots more, plus can trigger outside of cron but still need to throttle to oy one running at a time. Ultimately I'm calling a Java app with a task I can't guarantee will be safe with concurrent runs.

End edit.

Needs to take in a combo of script name + some shell environment variables to set and run each script with - name + vars should be passable as args.

Currently using batch (from at / atd). Works reliably eventually, but the limit of 1 job a minute slows things down, and batch also pauses when average cpu load gets too high - which is undesirable here.

Environment is pretty locked down with restrictions on software - or I would just spin up a jenkins. For this environment that would mean months of compliance checkboxes amd involving another team so I'm trying to skip around it.

Standard RHEL repo available software works. Or python stdlib. Suggestions for binaries or pip software outside that still welcome but major bonus points for extra standard stuff.

Thanks!

Hey everyone,

I'm trying to send a batch of messages to a service bus queue via the azure rest api. I'm able to send single messages just fine but having some trouble getting batches to show up correctly in the queue. Each batch is appearing in the queue as a single message, whereas I believe they should be being separated out into individual messages.

Following this doc:https://docs.microsoft.com/en-us/rest/api/servicebus/send-message-batch#request

Can't quite figure out what differentiates a single message from a batch aside from just passing an array rather than an object to queue.

Anyone familiar with service bus queues have any pointers?

EDIT:
Okay so it seems like the rest api may not be able to send batches to service bus queues. Seeing some conflicting information tbh from azure docs explaining how to send batches from rest api to azure .net docs explicitly stating that sending batches from rest api is not supported.
Honestly not sure anymore but I decided to just use the Node sdk to get around this and am now able to send batches of messages to service bus queues.

Torn between being grateful they had enough left for you - and wishing you had walked in 1 minute later

I have a case where I need to run a few tasks in sequence, one of these tasks requires performing the same number crunching on a large set of data, and would be suited to running in parallel as running sequentially would be prohibitively slow. Finally there's some other cleanup jobs that needs to run after all the parallel jobs have completed.

The Laravel docs mention about running Chains inside Batches, but not Batches inside Chains. Is such a thing possible?

Here's an example of what I'm trying to achieve:

Bus::chain([ 
  new SerialJobSetup, 
  new SerialJob2,
  Bus::batch([
    new ParallelJob(1), // Runs in Parallel on different queue workers
    new ParallelJob(2), // Runs in Parallel on different queue workers
    new ParallelJob(3), // Runs in Parallel on different queue workers
    new ParallelJob(4), // Runs in Parallel on different queue workers
    ...
  ]),
  new SerialJob3, // Continues to run the chain once all parallel jobs above have completed
  new SerialJobCleanup,
])->dispatch();

I'm pretty sure I've seen a https://twitter.com/themsaid presentation (perhaps it was for Laracon Online?) where he does something similar, but I can't for the life of me find it. I'm wondering if I dreamt it.

EDIT: The solution is not to use Bus::chain() at all!

SerialJobSetup::dispatchSync();
SerialJob2::dispatchSync();

Bus::batch([
    new ParallelJob(1), // Runs in Parallel on different queue workers
    new ParallelJob(2), // Runs in Parallel on different queue workers
    new ParallelJob(3), // Runs in Parallel on different queue workers
    new ParallelJob(4), // Runs in Parallel on different queue workers
    ...
])
->finally(function (Batch $batch) {
    SerialJob3::dispatchSync();
    SerialJobCleanup::dispatchSync();
})
->dispatch();

Bonus problem: when I got home, it turns out they gave me a pot of gravy instead of curry sauce - it was an absolute disaster

https://i.imgur.com/XH9IS53.png

Low paying batches will pop up in the queue fine after the notification flashes at the top of my screen. This "ghosting " only seems to happen on the higher paying batches.. $25+ and this happens while I am looking at my available batches screen.. Anyone else experiencing this?

I am looking for concrete examples why Job Queue could have more than one Compute Environment specified.

At first I thought "maybe I have multiple compute environments with different instance types and I let the queue know which order is preferred". However, one Compute Environment itself can have multiple types of instances specified and with proper allocationStrategy on a MANAGED cluster will automatically provision a suitable instance(in theory at least). That fact ruled out my initial idea.

So far I thought about following use cases:

• run tasks on SPOT instances, if none are available then fallback to compute environment with on demand ones
• use my own ECS Cluster but if no compute resources are available fallback to Batch managed cluster
• use environment with compute optimised instances but if none are available fallback to some generic, cheaper ones defined in other compute environment

Why else could that feature be useful?

I have a computer that interacts with an external device over serial basically. I have 10-15 people who log into this computer and run python scripts that control this external device. Each script takes about 2 minutes to run, but some are much longer. Right now everyone just runs their script and only one script can access the device at a time, however I would prefer a more efficient scheduling workflow. I envision something similar to how a super computer's resources are shared, except this server is limited not by computational power, but by access to this external device. Is there any program that can handle this? The platform would be Windows.

Dude. I dont know jack about 3d printing but i do know jill about industrial engineering. In the context of your sanitation "assembly" line. You can increase your throughput if you follow single piece flow. This works. 5 minute video explains it well. https://www.youtube.com/watch?v=ciJckWCMvpA

Leadtime = wip/exit rate or lead time = counf of pieces in between garbage bags on the dock and the hands of the hospital staff / count of pieces exiting per day

single piece flow lowers your wip which will decrease your lead time

I have 100 txt files with lots of links in each. I want to start one txt file after another automatically. I need the archive file and output directory named dynamically based on the txt file name (I'm already doing this).

Already asked in /r/youtubedl: https://old.reddit.com/r/youtubedl/comments/eqwzxd/how_to_do_a_queue_of_batch_files/

Who’s in the same batch as me?

When are you getting your results?

Hey! I do have multiworld setup but it's not on the latest version of the alttpr official site.

I won't have net for a possibly up to a week or two and it will just be me and my PC for that time. Although I could generate seeds offline with the Multiworld gui.py, I'm wondering if there is a way to batch generate/download a large number of seeds at once.

If not, all good. I will end up downloading 50 or so manually if I have to! :D

I have hundreds of clips I need tracked and they're taking a while. is it possible to create a batch queue?

Shuttle/Shuttle+ is a lightweight, intuitive music player for Android. It's been around for a while now, and things are really starting to pick up. Shuttle free recently passed the 50k downloads mark, a proud moment for me!

I've been working extremely hard over the past month to bring multi-select functionality to Shuttle (think batch add to playlists), as well as major performance improvements and bug fixes. There's a lot more eye candy now, thanks to the help of /u/jessecoleman and his design input.

I've also had some help from Andrew Neal of Apollo Music Player, to iron out some bugs and improve the performance of the player. He's been gently encouraging me to make more of an effort giving Apollo credit, as recently Shuttle has adopted more code based off of Apollo. That is to say, yes, there are some parts of Shuttle which are based on the source code of Apollo Music Player. Thanks to Andrew for his hard work on Apollo, and for giving up his time to lend a hand.

Unfortunately, folder browsing did not make the cut for this update. The groundwork is there, but it was too unstable, so it's stuck in the alpha testing phase until I kill some more bugs.

Shuttle+ is currently on sale for ~99c. The paid version has tag editing, and folder browsing is just around the corner, which will be a paid feature as well. Shuttle+ also sports an extra theme, and I hope to include more of those in the near future. In the huge overhaul that was this update, I've also removed the ability to navigate directly back to an artist/album from the 'now playing' page. This is only temporary, and I hope to include that functionality back in for the next update.

The free version is completely ad-free, and always will be, so if you can't afford or don't have access to the Play Store, or you simply don't buy apps.. Grab a copy of that over here

I'm currently awaiting musiXmatch approval for the use of their plugin, to bring lyrics support to Shuttle.

Shuttle does not support playback of music stored in the cloud (Google all access and the like), due to the lack of an official API.

Also, there are still some known issues on some Galaxy S3's, causing issues with the sound output and equalizer. I'm

A couple days ago, I released v0.1 of batch, a distributed task queue library (think celery or resque).

This library allows you to send tasks to a RabbitMQ broker, so that a worker will be able to pull it and execute the associated handler. It leverages the futures and tokio-core crates to provide asynchronous I/O operations. It tries be as safe as possible while still feeling productive and expressive.

#[derive(Serialize, Deserialize, Task)]
#[task_routing_key = "hello-world"]
struct SayHello {
    to: String,
}

fn main() {
    let mut core = Core::new().unwrap();
    let client = ClientBuilder::new()
        .connection_url("amqp://localhost/%2f")
        .handle(core.handle())
        .build();
    let send = client.and_then(|client| {
        job(SayHello { to: "Ferris".into() }).send(&client)
    });
    core.run(send).unwrap();
}

See the examples or the user guide for more information.

I’m glad nobody took it last night, got it back with a nice peak.. :)

First I give some overview of the system.

In the system user creates project. And in that project user can perform various task. Those task are very long running and do many thing. So we use the Spring Batch to run those task. When an user submit a task we insert that into DB. And there is a Scheduler that retrieve those task and fire. A pseudocode has given.

    @Scheduled(fixedRate =SCHEDULER_REPEAT_TIME, initialDelay = SCHEDULER_INITIAL_DELAY_TIME)
        public void executeLongRunningTask() throws InterruptedException {
    
        // Retrieve every Job from every project from DB which are not run yet.
        List<JobExecution> taskList = SpringJPADao.getTaskExecutionList(TaskExecutionStatusType.QUEUED);
        
        // Loop through and run 
        for (JobExecution job : taskList) {
            jobLauncher.run(job, jobParameters);
        }
    }

Now the There are some job, if they run concurrently then problems occur. For example suppose there are four jobs. j1, j2, j3, j4. The requirement is j1 and j2 should not be run concurrently. Even two j1 sob should not be run concurrently. But all this are specific to a particular project. That means j1 from Project1 and another j1 from project2 can be run concurrently.

Currently I have solve this one by keeping a flag for a particular project in **DB**. Before running a job I check if the flag is on. Like

        // Loop through and run 
        for (JobExecution job : taskList) {
            // check by project id if there is any job running
            if (taskSemaphore.isRunning(job.getProjectId())) continue;
            
            // acquire lock on the project
            taskSemaphore.acquireLock(job.getProjectId());
            jobLauncher.run(job, jobParameters);
        }

And release the lock in the `afterJob()` callback provided by the Spring Job by `JobExecutionListener` interface.

And also I have implemented a another scheduler that monitor if there is any job that gets locked for 30 minutes. So if there is any release the lock.

We use DB for job queuing and also the above solution that I currently implemented.

This post is intended for discussion. I am actually looking for how others would approach this kinda problem. Any suggestion or opinion would be appreciated. Thanks

Hi,

I'm using the sequencer for several visualizations and would like to export the animation by shot rather than one whole sequencer timeline.

Currently, I'm doing it manually. Open a shot. Render it. Open a shot. Render it.

Is there a way to batch render? Select all shots and just queue them altogether.

There is wiki about this https://wiki.unrealengine.com/Sequencer_Batch_Rendering
but the command line is beyond my skill set.