What is the proper way to atomically update a vector or a slice that overlaps between multiple threads?
I want to some work on a vector shared by multiple threads but I don't want to use a Mutex
because it is not wait-free.
The code below is written as I would in C.
#![feature(core_intrinsics, ptr_internals)]
use std::intrinsics::atomic_xadd_rel;
use std::ptr::Unique;
use std::thread::spawn;
fn main() {
let mut data = [0; 8];
let mut pool = Vec::with_capacity(8);
for index in 0..8 {
let data_ptr = Unique::new(data.as_mut_ptr());
pool.push(spawn(move || {
println!("Thread {} -> {}", index, unsafe {
atomic_xadd_rel(
data_ptr
.unwrap()
.as_ptr()
.add(if index % 2 != 0 { index - 1 } else { index }),
1,
)
});
}));
}
for work in pool {
work.join().unwrap();
}
println!("Data {:?}", data);
}
I've also written the code using only the stable API:
use std::iter::repeat_with;
use std::sync::atomic::{AtomicUsize, Ordering::*};
use std::sync::Arc;
use std::thread::spawn;
fn main() {
let data = Arc::new(
repeat_with(|| AtomicUsize::new(0))
.take(8)
.collect::<Vec<_>>(),
);
let mut pool = Vec::with_capacity(8);
for index in 0..8 {
let data_clone = data.clone();
pool.push(spawn(move || {
let offset = index - (index % 2 != 0) as usize;
println!(
"Thread {} -> {}",
index,
data_clone[offset].fetch_add(1, Relaxed)
);
}));
}
for work in pool {
work.join().unwrap();
}
println!("Data {:?}", data);
}
This code returns
Thread 0 -> 0
Thread 1 -> 1
Thread 3 -> 0
Thread 5 -> 1
Thread 7 -> 1
Thread 2 -> 1
Thread 6 -> 0
Thread 4 -> 0
Data [2, 0, 2, 0, 2, 0, 2, 0]
Is there is a proper way to do this in Rust?
I do not think this is a duplicate of How do I pass disjoint slices from a vector to different threads? because my vector / slice elements overlap between threads. In my sample, each odd index of the slice is incremented twice by two different threads.
rust
add a comment |
I want to some work on a vector shared by multiple threads but I don't want to use a Mutex
because it is not wait-free.
The code below is written as I would in C.
#![feature(core_intrinsics, ptr_internals)]
use std::intrinsics::atomic_xadd_rel;
use std::ptr::Unique;
use std::thread::spawn;
fn main() {
let mut data = [0; 8];
let mut pool = Vec::with_capacity(8);
for index in 0..8 {
let data_ptr = Unique::new(data.as_mut_ptr());
pool.push(spawn(move || {
println!("Thread {} -> {}", index, unsafe {
atomic_xadd_rel(
data_ptr
.unwrap()
.as_ptr()
.add(if index % 2 != 0 { index - 1 } else { index }),
1,
)
});
}));
}
for work in pool {
work.join().unwrap();
}
println!("Data {:?}", data);
}
I've also written the code using only the stable API:
use std::iter::repeat_with;
use std::sync::atomic::{AtomicUsize, Ordering::*};
use std::sync::Arc;
use std::thread::spawn;
fn main() {
let data = Arc::new(
repeat_with(|| AtomicUsize::new(0))
.take(8)
.collect::<Vec<_>>(),
);
let mut pool = Vec::with_capacity(8);
for index in 0..8 {
let data_clone = data.clone();
pool.push(spawn(move || {
let offset = index - (index % 2 != 0) as usize;
println!(
"Thread {} -> {}",
index,
data_clone[offset].fetch_add(1, Relaxed)
);
}));
}
for work in pool {
work.join().unwrap();
}
println!("Data {:?}", data);
}
This code returns
Thread 0 -> 0
Thread 1 -> 1
Thread 3 -> 0
Thread 5 -> 1
Thread 7 -> 1
Thread 2 -> 1
Thread 6 -> 0
Thread 4 -> 0
Data [2, 0, 2, 0, 2, 0, 2, 0]
Is there is a proper way to do this in Rust?
I do not think this is a duplicate of How do I pass disjoint slices from a vector to different threads? because my vector / slice elements overlap between threads. In my sample, each odd index of the slice is incremented twice by two different threads.
rust
1
Possible duplicate of How do I pass disjoint slices from a vector to different threads?
– Lucretiel
Nov 22 '18 at 0:17
add a comment |
I want to some work on a vector shared by multiple threads but I don't want to use a Mutex
because it is not wait-free.
The code below is written as I would in C.
#![feature(core_intrinsics, ptr_internals)]
use std::intrinsics::atomic_xadd_rel;
use std::ptr::Unique;
use std::thread::spawn;
fn main() {
let mut data = [0; 8];
let mut pool = Vec::with_capacity(8);
for index in 0..8 {
let data_ptr = Unique::new(data.as_mut_ptr());
pool.push(spawn(move || {
println!("Thread {} -> {}", index, unsafe {
atomic_xadd_rel(
data_ptr
.unwrap()
.as_ptr()
.add(if index % 2 != 0 { index - 1 } else { index }),
1,
)
});
}));
}
for work in pool {
work.join().unwrap();
}
println!("Data {:?}", data);
}
I've also written the code using only the stable API:
use std::iter::repeat_with;
use std::sync::atomic::{AtomicUsize, Ordering::*};
use std::sync::Arc;
use std::thread::spawn;
fn main() {
let data = Arc::new(
repeat_with(|| AtomicUsize::new(0))
.take(8)
.collect::<Vec<_>>(),
);
let mut pool = Vec::with_capacity(8);
for index in 0..8 {
let data_clone = data.clone();
pool.push(spawn(move || {
let offset = index - (index % 2 != 0) as usize;
println!(
"Thread {} -> {}",
index,
data_clone[offset].fetch_add(1, Relaxed)
);
}));
}
for work in pool {
work.join().unwrap();
}
println!("Data {:?}", data);
}
This code returns
Thread 0 -> 0
Thread 1 -> 1
Thread 3 -> 0
Thread 5 -> 1
Thread 7 -> 1
Thread 2 -> 1
Thread 6 -> 0
Thread 4 -> 0
Data [2, 0, 2, 0, 2, 0, 2, 0]
Is there is a proper way to do this in Rust?
I do not think this is a duplicate of How do I pass disjoint slices from a vector to different threads? because my vector / slice elements overlap between threads. In my sample, each odd index of the slice is incremented twice by two different threads.
rust
I want to some work on a vector shared by multiple threads but I don't want to use a Mutex
because it is not wait-free.
The code below is written as I would in C.
#![feature(core_intrinsics, ptr_internals)]
use std::intrinsics::atomic_xadd_rel;
use std::ptr::Unique;
use std::thread::spawn;
fn main() {
let mut data = [0; 8];
let mut pool = Vec::with_capacity(8);
for index in 0..8 {
let data_ptr = Unique::new(data.as_mut_ptr());
pool.push(spawn(move || {
println!("Thread {} -> {}", index, unsafe {
atomic_xadd_rel(
data_ptr
.unwrap()
.as_ptr()
.add(if index % 2 != 0 { index - 1 } else { index }),
1,
)
});
}));
}
for work in pool {
work.join().unwrap();
}
println!("Data {:?}", data);
}
I've also written the code using only the stable API:
use std::iter::repeat_with;
use std::sync::atomic::{AtomicUsize, Ordering::*};
use std::sync::Arc;
use std::thread::spawn;
fn main() {
let data = Arc::new(
repeat_with(|| AtomicUsize::new(0))
.take(8)
.collect::<Vec<_>>(),
);
let mut pool = Vec::with_capacity(8);
for index in 0..8 {
let data_clone = data.clone();
pool.push(spawn(move || {
let offset = index - (index % 2 != 0) as usize;
println!(
"Thread {} -> {}",
index,
data_clone[offset].fetch_add(1, Relaxed)
);
}));
}
for work in pool {
work.join().unwrap();
}
println!("Data {:?}", data);
}
This code returns
Thread 0 -> 0
Thread 1 -> 1
Thread 3 -> 0
Thread 5 -> 1
Thread 7 -> 1
Thread 2 -> 1
Thread 6 -> 0
Thread 4 -> 0
Data [2, 0, 2, 0, 2, 0, 2, 0]
Is there is a proper way to do this in Rust?
I do not think this is a duplicate of How do I pass disjoint slices from a vector to different threads? because my vector / slice elements overlap between threads. In my sample, each odd index of the slice is incremented twice by two different threads.
rust
rust
edited Nov 22 '18 at 21:15
Shepmaster
151k13293432
151k13293432
asked Nov 21 '18 at 23:48
The_Server201The_Server201
63
63
1
Possible duplicate of How do I pass disjoint slices from a vector to different threads?
– Lucretiel
Nov 22 '18 at 0:17
add a comment |
1
Possible duplicate of How do I pass disjoint slices from a vector to different threads?
– Lucretiel
Nov 22 '18 at 0:17
1
1
Possible duplicate of How do I pass disjoint slices from a vector to different threads?
– Lucretiel
Nov 22 '18 at 0:17
Possible duplicate of How do I pass disjoint slices from a vector to different threads?
– Lucretiel
Nov 22 '18 at 0:17
add a comment |
1 Answer
1
active
oldest
votes
Assuming that each thread has unique access to a particular element or sub-slice of your vector, this would be a case to use split_at
(or one of the similar functions). split_at
splits a mutable slice into two independent mutable slices; you can call it multiple times to split your slice into the correct number of segments, and pass each sub-slice to a separate thread.
The best way to pass the sub-slices to a thread would be to use something like the scoped threads in crossbeam.
So, you agree this is a duplicate of the proposed duplicate?
– Shepmaster
Nov 22 '18 at 0:13
Oh, I didn't see that. Their solution is different, but yes,
– Lucretiel
Nov 22 '18 at 0:17
The OP has edited the question such that this answer is no longer valid —split_at
is impossible to call here.
– Shepmaster
Nov 22 '18 at 21:17
add a comment |
Your Answer
StackExchange.ifUsing("editor", function () {
StackExchange.using("externalEditor", function () {
StackExchange.using("snippets", function () {
StackExchange.snippets.init();
});
});
}, "code-snippets");
StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "1"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);
StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});
function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: true,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: 10,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});
}
});
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53422033%2fwhat-is-the-proper-way-to-atomically-update-a-vector-or-a-slice-that-overlaps-be%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
1 Answer
1
active
oldest
votes
1 Answer
1
active
oldest
votes
active
oldest
votes
active
oldest
votes
Assuming that each thread has unique access to a particular element or sub-slice of your vector, this would be a case to use split_at
(or one of the similar functions). split_at
splits a mutable slice into two independent mutable slices; you can call it multiple times to split your slice into the correct number of segments, and pass each sub-slice to a separate thread.
The best way to pass the sub-slices to a thread would be to use something like the scoped threads in crossbeam.
So, you agree this is a duplicate of the proposed duplicate?
– Shepmaster
Nov 22 '18 at 0:13
Oh, I didn't see that. Their solution is different, but yes,
– Lucretiel
Nov 22 '18 at 0:17
The OP has edited the question such that this answer is no longer valid —split_at
is impossible to call here.
– Shepmaster
Nov 22 '18 at 21:17
add a comment |
Assuming that each thread has unique access to a particular element or sub-slice of your vector, this would be a case to use split_at
(or one of the similar functions). split_at
splits a mutable slice into two independent mutable slices; you can call it multiple times to split your slice into the correct number of segments, and pass each sub-slice to a separate thread.
The best way to pass the sub-slices to a thread would be to use something like the scoped threads in crossbeam.
So, you agree this is a duplicate of the proposed duplicate?
– Shepmaster
Nov 22 '18 at 0:13
Oh, I didn't see that. Their solution is different, but yes,
– Lucretiel
Nov 22 '18 at 0:17
The OP has edited the question such that this answer is no longer valid —split_at
is impossible to call here.
– Shepmaster
Nov 22 '18 at 21:17
add a comment |
Assuming that each thread has unique access to a particular element or sub-slice of your vector, this would be a case to use split_at
(or one of the similar functions). split_at
splits a mutable slice into two independent mutable slices; you can call it multiple times to split your slice into the correct number of segments, and pass each sub-slice to a separate thread.
The best way to pass the sub-slices to a thread would be to use something like the scoped threads in crossbeam.
Assuming that each thread has unique access to a particular element or sub-slice of your vector, this would be a case to use split_at
(or one of the similar functions). split_at
splits a mutable slice into two independent mutable slices; you can call it multiple times to split your slice into the correct number of segments, and pass each sub-slice to a separate thread.
The best way to pass the sub-slices to a thread would be to use something like the scoped threads in crossbeam.
answered Nov 22 '18 at 0:11
LucretielLucretiel
813924
813924
So, you agree this is a duplicate of the proposed duplicate?
– Shepmaster
Nov 22 '18 at 0:13
Oh, I didn't see that. Their solution is different, but yes,
– Lucretiel
Nov 22 '18 at 0:17
The OP has edited the question such that this answer is no longer valid —split_at
is impossible to call here.
– Shepmaster
Nov 22 '18 at 21:17
add a comment |
So, you agree this is a duplicate of the proposed duplicate?
– Shepmaster
Nov 22 '18 at 0:13
Oh, I didn't see that. Their solution is different, but yes,
– Lucretiel
Nov 22 '18 at 0:17
The OP has edited the question such that this answer is no longer valid —split_at
is impossible to call here.
– Shepmaster
Nov 22 '18 at 21:17
So, you agree this is a duplicate of the proposed duplicate?
– Shepmaster
Nov 22 '18 at 0:13
So, you agree this is a duplicate of the proposed duplicate?
– Shepmaster
Nov 22 '18 at 0:13
Oh, I didn't see that. Their solution is different, but yes,
– Lucretiel
Nov 22 '18 at 0:17
Oh, I didn't see that. Their solution is different, but yes,
– Lucretiel
Nov 22 '18 at 0:17
The OP has edited the question such that this answer is no longer valid —
split_at
is impossible to call here.– Shepmaster
Nov 22 '18 at 21:17
The OP has edited the question such that this answer is no longer valid —
split_at
is impossible to call here.– Shepmaster
Nov 22 '18 at 21:17
add a comment |
Thanks for contributing an answer to Stack Overflow!
- Please be sure to answer the question. Provide details and share your research!
But avoid …
- Asking for help, clarification, or responding to other answers.
- Making statements based on opinion; back them up with references or personal experience.
To learn more, see our tips on writing great answers.
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fstackoverflow.com%2fquestions%2f53422033%2fwhat-is-the-proper-way-to-atomically-update-a-vector-or-a-slice-that-overlaps-be%23new-answer', 'question_page');
}
);
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Sign up or log in
StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Sign up using Google
Sign up using Facebook
Sign up using Email and Password
Post as a guest
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
Required, but never shown
1
Possible duplicate of How do I pass disjoint slices from a vector to different threads?
– Lucretiel
Nov 22 '18 at 0:17