is it possible to use solvepde (from PDE toolbox) inside a parfor loop (parallel computing toolbox)?

Hey,

I want to speed up the simulation of multiple cases using the PDE toolbox. Is it possible to run the solvepde command in a parfor-loop or similar, like parfeval?

I know that you cant speed up the PDE toolbox by parallelization, therefore I want to send each case to a seperate worker to use CPU cores.

When running a simulation in a for loop it works as expected. The results of the parfor loop are total nonsense and differ very much of the correct results.

A minimum working example is posted here: https://de.mathworks.com/matlabcentral/answers/1624710-parfor-loop-leads-to-wrong-results-of-pde-solver?s_tid=srchtitle

Do you have any suggestions?

EDIT: got a solution, its also in the mathworks forum post

This is a bug when the model gets transferred to the worker in the process of parfor execution. I apologize for the inconvenience. Here is a workaround:

Chage the line:

applyBoundaryCondition(model,'dirichlet','Edge',4,'u',Cfeed);

to

applyBoundaryCondition(model,'dirichlet','Edge',4,'r',Cfeed);

Now the parfor results are as expected. unfortunately I couldnt find a solution to make it work with a mixed boundary condition. Will report back if I can fix it.

EDIT2: I updated the forums post with a working solution for the mixed boundary conditions. Case closed :)

πŸ‘︎ 7
πŸ’¬︎
πŸ‘€︎ u/X803828
πŸ“…︎ Jan 08 2022
🚨︎ report
Pytorch Distributed Parallel Computing or Hpc Research

Does anyone have some good Research or latest papers with code for Distributed Parallel Computing or HPC Research? Anyone would like to share some projects, ideas, codes repo so on.

πŸ‘︎ 4
πŸ’¬︎
πŸ“…︎ Jan 12 2022
🚨︎ report
MapReduce v1.0.0 - An easy-to-use parallel-computing framework in Go. github.com/BWbwchen/MapRe…
πŸ‘︎ 58
πŸ’¬︎
πŸ‘€︎ u/blackconqueror
πŸ“…︎ Dec 11 2021
🚨︎ report
Parallel Computing: Best Subset Selection glm's for Windows

Has someone seen an out-of-box solution for finding the best subset selection for glm's, allowing both for interaction of the variables as well as multi-core preccesing?

The clostest to it i could find was the package rFSA with its FSA() function, however, if the function detecs the use of windows it sets the number of cores automatically to 1.

πŸ‘︎ 2
πŸ’¬︎
πŸ‘€︎ u/props2me
πŸ“…︎ Jan 14 2022
🚨︎ report
Scaling teams like parallel computing systems: Amdahl's law getsturdy.com/blog/2021-1…
πŸ‘︎ 73
πŸ’¬︎
πŸ‘€︎ u/icyFur
πŸ“…︎ Nov 30 2021
🚨︎ report
MapReduce v1.0.0 - An easy-to-use parallel-computing framework in Go. github.com/BWbwchen/MapRe…
πŸ‘︎ 20
πŸ’¬︎
πŸ‘€︎ u/blackconqueror
πŸ“…︎ Dec 11 2021
🚨︎ report
parallel computing? openmp or mpi

A long underground tunnel has been built cutting across a mountain. Due to the difficult terrain, the tunnel had to be pretty narrow and the width was just sufficient to accommodate one vehicle. Also, as some sections of the tunnel had bridges over very deep gorges, it was decided to let only one vehicle into the tunnel at any time. Each end of the tunnel has a controller which

regulates entry into the tunnel and also tracks exit of the vehicles from the tunnel. Write a multi- threaded program to mimic this system. Assume, that at any time a random number of vehicles

are present at the entrances.

the confusion is what to be used openmp or mpi, if possible if anyone can please provide the solution using either

πŸ‘︎ 4
πŸ’¬︎
πŸ‘€︎ u/constreact
πŸ“…︎ Dec 16 2021
🚨︎ report
C++ Workflow : C++Parallel Computing and Asynchronous Networking Engine

Github link

C++ Workflow is a light weighted Asynchronous Network Framework and its elegant design can satisfy most C++ back-end development requirements including search services, HTTP applications, online advertisements, etc.

To quickly build an HTTP server:

#include <stdio.h>
#include "workflow/WFHttpServer.h"

int main()
{
    WFHttpServer server([](WFHttpTask *task) {
        task->get_resp()->append_output_body("<html>Hello World!</html>");
    });

    if (server.start(8888) == 0) { // start server on port 8888
        getchar(); // press "Enter" to end.
        server.stop();
    }

    return 0;
}
  • It currently supports HTTP, Redis, MySQL, and Kafka protocols.
  • It has built-in service governance and load balancing features.
  • ...

For more information, you can see the github.

Any feedback would be greatly appreciated!

πŸ‘︎ 4
πŸ’¬︎
πŸ‘€︎ u/-InvalidName
πŸ“…︎ Jan 04 2022
🚨︎ report
Parallel computing course

I'm considering taking parallel computing next sem . I had a few questions about that course.

  1. does it have exams / final exam
  2. is it only Theory or does it have practical stuff as well.
πŸ‘︎ 13
πŸ’¬︎
πŸ‘€︎ u/hhn2505
πŸ“…︎ Nov 05 2021
🚨︎ report
MapReduce v1.0.0 - An easy-to-use parallel-computing framework in Go. github.com/BWbwchen/MapRe…
πŸ‘︎ 3
πŸ’¬︎
πŸ‘€︎ u/blackconqueror
πŸ“…︎ Dec 11 2021
🚨︎ report
LispWorks vs others for parallel computing

I read a comment online saying LispWorks had fantastic support for parallel computing. So that part is true.

I wanted to solicit OBJECTIVE opinions on how LW compares against ACL and SBCL in this regard. Everybody has their own favourites, so please refrain from commenting unless you have factual information on the comparison.

I am expecting this thread to go unanswered for the above reason, but I wanted to try in case any body had something meaningful to share. So this is less of an informal discussion, more of something more serious (apologies if my tone is strong, I wanted to save everyone’s time and communicate what I am after)

Thanks in advance!

πŸ‘︎ 13
πŸ’¬︎
πŸ‘€︎ u/Yava2000
πŸ“…︎ Nov 13 2021
🚨︎ report
Is parallel computing essential for backend development?

Hi everyone,

What are you thought about learning parallel computing for backend development?

Thank you for sharing your thought.

πŸ‘︎ 5
πŸ’¬︎
πŸ“…︎ Dec 05 2021
🚨︎ report
Dask – a flexible library for parallel computing in Python dask.org/
πŸ‘︎ 12
πŸ’¬︎
πŸ‘€︎ u/binaryfor
πŸ“…︎ Nov 18 2021
🚨︎ report
CS122 Parallel Computing with Joel Grodstein

Has anyone taken this class before, or any other class with Joel Grodstein?

πŸ‘︎ 2
πŸ’¬︎
πŸ“…︎ Nov 17 2021
🚨︎ report
Announce par-stream v0.5.0, a toolkit for parallel and asynchronous computing.

[ GitHub | crates.io | API Docs ]

Hi Rustaceans!

I glad to present par-stream. Now it supports tokio, async-std and smol runtimes.

It lets you build iterator style data pipeline that automatically scales to multiple processors. For who knows rayon, it's an asynchronous programming counterpart.

The v0.5.0 features scatter-gather and tee-zip patterns, making it simple to fork and join data streams.

let orig: Vec<_> = (0..1000).collect();

let rx1 = futures::stream::iter(orig.clone()).tee(1);
let rx2 = rx1.clone();
let rx3 = rx1.clone();

let fut1 = rx1.map(|val| val).collect();
let fut2 = rx2.map(|val| val * 2).collect();
let fut3 = rx3.map(|val| val * 3).collect();

let (vec1, vec2, vec3): (Vec<_>, Vec<_>, Vec<_>) = futures::join!(fut1, fut2, fut3);

It is demonstrated to implement a unsafe-free parallel merge-sort (code link). With carefully tweak chunk size, it can out-perform std sort on large array.

πŸ‘︎ 16
πŸ’¬︎
πŸ‘€︎ u/jerry73204
πŸ“…︎ Oct 03 2021
🚨︎ report
Parallel computing within a SAS proc

I am interested in parallelizing inside a proc. I want to run:

proc lifereg data=main;
by SampleNo;
model statement etc.
run;

Where each sample executes at the same time. Is that possible?

I looked at this paper:

http://www.lexjansen.com/wuss/2018/15_Final_Paper_PDF.pdf

But it focuses on simultaneously executing procs that don't rely on one another. If you have six proc freqs listed one after the other and the data for the remaining proc freqs don't depend on the first one, then you can run all six at the same time, combine the results and continue with the rest of the program.

Thank you.

πŸ‘︎ 4
πŸ’¬︎
πŸ‘€︎ u/centipedeshoesale
πŸ“…︎ Sep 17 2021
🚨︎ report
CIA long relied exclusively on Amazon for its cloud computing. Now it is seeking multiple providers for a massive new contract. (2019): C2E Commercial Cloud Enterprise, builds on $600 million Amazon’s cloud computing division. Runs parallel $10 billion cloud effort pursued by Defense Department. washingtonpost.com/busine…
πŸ‘︎ 2
πŸ’¬︎
πŸ“…︎ Oct 20 2021
🚨︎ report
The Wild West of Parallel Computing – Review of Bodo.ai confessionsofadataguy.com…
πŸ‘︎ 2
πŸ’¬︎
πŸ‘€︎ u/dataengineerdude
πŸ“…︎ Sep 24 2021
🚨︎ report
Trying to learn parallel computing. I have access to a cluster to try some projects but I don’t know enough to do anything.

Very little learned so far in these two weeks. Luckily I’ve been given logins to an hpc cluster for β€˜research’ and I’m being supervised by an hpc researcher. The researcher has asked me to do things that sound really simple but I’m clueless. I’m also embarrassed to ask him how to. Things like checking the C/C++ compilers that the cluster has, which APIs the GPUs have etc. I feel I’m not googling the right things too. Any help?

πŸ‘︎ 6
πŸ’¬︎
πŸ‘€︎ u/kAnim007
πŸ“…︎ Jul 08 2021
🚨︎ report
ITCS 3145 Parallel & Distributed Computing with Eric Saule

Did anyone take this class with Saule before? I need help and I cant find anyone to help me

πŸ‘︎ 3
πŸ’¬︎
πŸ“…︎ Sep 20 2021
🚨︎ report
CS451 β€œIntroduction to Parallel and Distributed Computing” Homework 3……solved essaycode.com/product/cs4…
πŸ‘︎ 2
πŸ’¬︎
πŸ‘€︎ u/essaycode
πŸ“…︎ Sep 19 2021
🚨︎ report
PyTorch Distributed Parallel Computing, HPC Research

Does anyone have some good Research or latest papers with code for Distributed Parallel Computing or HPC Research? Anyone would like to share some projects, ideas, codes repo so on.

πŸ‘︎ 9
πŸ’¬︎
πŸ“…︎ Jan 12 2022
🚨︎ report
parallel computing? openmp or mpi

A long underground tunnel has been built cutting across a mountain. Due to the difficult terrain, the tunnel had to be pretty narrow and the width was just sufficient to accommodate one vehicle. Also, as some sections of the tunnel had bridges over very deep gorges, it was decided to let only one vehicle into the tunnel at any time. Each end of the tunnel has a controller which

regulates entry into the tunnel and also tracks exit of the vehicles from the tunnel. Write a multi- threaded program to mimic this system. Assume, that at any time a random number of vehicles

are present at the entrances.

the confusion is what to be used openmp or mpi, if possible if anyone can please provide the solution using either

πŸ‘︎ 3
πŸ’¬︎
πŸ‘€︎ u/constreact
πŸ“…︎ Dec 16 2021
🚨︎ report

Please note that this site uses cookies to personalise content and adverts, to provide social media features, and to analyse web traffic. Click here for more information.