Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(485)

Unified Diff: webrtc/modules/audio_processing/beamformer_unittest.cc

Issue 1806853004: Added a bitexactness test for the beamformer in the audio processing module (Closed) Base URL: https://chromium.googlesource.com/external/webrtc.git@AgcBitExactness_CL
Patch Set: Created 4 years, 9 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View side-by-side diff with in-line comments
Download patch
« no previous file with comments | « no previous file | webrtc/modules/modules.gyp » ('j') | webrtc/modules/modules.gyp » ('J')
Expand Comments ('e') | Collapse Comments ('c') | Show Comments Hide Comments ('s')
Index: webrtc/modules/audio_processing/beamformer_unittest.cc
diff --git a/webrtc/modules/audio_processing/beamformer_unittest.cc b/webrtc/modules/audio_processing/beamformer_unittest.cc
new file mode 100644
index 0000000000000000000000000000000000000000..fa525918af0e7f402ef543670c87da1ba2000443
--- /dev/null
+++ b/webrtc/modules/audio_processing/beamformer_unittest.cc
@@ -0,0 +1,249 @@
+/*
+ * Copyright (c) 2016 The WebRTC project authors. All Rights Reserved.
+ *
+ * Use of this source code is governed by a BSD-style license
+ * that can be found in the LICENSE file in the root of the source
+ * tree. An additional intellectual property rights grant can be found
+ * in the file PATENTS. All contributing project authors may
+ * be found in the AUTHORS file in the root of the source tree.
+ */
+#include <vector>
+
+#include "testing/gtest/include/gtest/gtest.h"
+#include "webrtc/base/array_view.h"
+#include "webrtc/modules/audio_processing/audio_buffer.h"
+#include "webrtc/modules/audio_processing/beamformer/nonlinear_beamformer.h"
+#include "webrtc/modules/audio_processing/test/audio_buffer_tools.h"
+#include "webrtc/modules/audio_processing/test/bitexactness_tools.h"
+
+namespace webrtc {
+namespace {
+
+const int kNumFramesToProcess = 1000;
aluebs-webrtc 2016/03/18 22:51:51 Should probably be a size_t.
peah-webrtc 2016/03/21 08:02:07 Done.
+
+void ProcessOneFrame(int sample_rate_hz,
aluebs-webrtc 2016/03/18 22:51:52 You don't need to pass in the sample_rate_hz separ
peah-webrtc 2016/03/21 08:02:07 I cannot see that the AudioBuffer returns the samp
aluebs-webrtc 2016/03/22 12:15:55 You are right, my bad.
peah-webrtc 2016/03/23 22:06:20 Acknowledged.
+ AudioBuffer* capture_audio_buffer,
+ Beamformer<float>* beamformer) {
+ if (sample_rate_hz > AudioProcessing::kSampleRate16kHz) {
+ capture_audio_buffer->SplitIntoFrequencyBands();
+ }
+
+ beamformer->ProcessChunk(*capture_audio_buffer->split_data_f(),
aluebs-webrtc 2016/03/18 22:51:50 After running the beamformer, the number of channe
peah-webrtc 2016/03/21 08:02:08 Thanks! I saw that from the AudioProcessingImpl bu
aluebs-webrtc 2016/03/22 12:15:55 That is done so that the AudioBuffer is aware abou
peah-webrtc 2016/03/23 22:06:20 Acknowledged.
+ capture_audio_buffer->split_data_f());
+
+ if (sample_rate_hz > AudioProcessing::kSampleRate16kHz) {
+ capture_audio_buffer->MergeFrequencyBands();
+ }
+}
+
+void RunBitExactnessTest(int sample_rate_hz,
+ const std::vector<Point>& array_geometry,
+ const SphericalPointf& target_direction,
+ const rtc::ArrayView<const float>& output_reference) {
aluebs-webrtc 2016/03/18 22:51:52 In the ArrayView documentation it says: "ArrayView
peah-webrtc 2016/03/21 08:02:07 Done.
+ NonlinearBeamformer beamformer(array_geometry, target_direction);
+ beamformer.Initialize(10, sample_rate_hz > 16000 ? 16000 : sample_rate_hz);
aluebs-webrtc 2016/03/18 22:51:52 Use AudioProcessing::kChunkSizeMs instead of 10, o
peah-webrtc 2016/03/21 08:02:07 Done.
+
+ int samples_per_channel = rtc::CheckedDivExact(sample_rate_hz, 100);
aluebs-webrtc 2016/03/18 22:51:52 You don't need to calculate this explicitly, you c
peah-webrtc 2016/03/21 08:02:07 Done.
+ const StreamConfig capture_config(sample_rate_hz, 2, false);
aluebs-webrtc 2016/03/18 22:51:51 Use array_geometry.size() instead of hardcoding 2.
peah-webrtc 2016/03/21 08:02:09 Done.
+ AudioBuffer capture_buffer(
+ capture_config.num_frames(), capture_config.num_channels(),
+ capture_config.num_frames(), capture_config.num_channels(),
aluebs-webrtc 2016/03/18 22:51:51 num_process_channels should probably be mono, when
peah-webrtc 2016/03/21 08:02:07 No, that does not work, as the CopyFrom then produ
aluebs-webrtc 2016/03/22 12:15:55 Yes, you are right. My bad.
peah-webrtc 2016/03/23 22:06:20 Acknowledged.
+ capture_config.num_frames());
+ test::InputAudioFile capture_file(
+ test::GetApmCaptureTestVectorFileName(sample_rate_hz));
+ std::vector<float> capture_input(samples_per_channel * 2);
aluebs-webrtc 2016/03/18 22:51:51 Use capture_config.num_channels() or capture_buffe
peah-webrtc 2016/03/21 08:02:08 Done.
+ for (size_t frame_no = 0; frame_no < kNumFramesToProcess; ++frame_no) {
aluebs-webrtc 2016/03/18 22:51:51 0u?
peah-webrtc 2016/03/21 08:02:08 Done.
+ ReadFloatSamplesFromStereoFile(samples_per_channel, 2, &capture_file,
aluebs-webrtc 2016/03/18 22:51:51 Where does this function come from? Also use captu
peah-webrtc 2016/03/21 08:02:06 The function is declared in webrtc/modules/audio_p
aluebs-webrtc 2016/03/22 12:15:55 Thanks for clarifying. I am not sure why this didn
peah-webrtc 2016/03/23 22:06:19 Acknowledged.
+ capture_input);
+
+ test::CopyVectorToAudioBuffer(capture_config, capture_input,
+ &capture_buffer);
+
+ ProcessOneFrame(sample_rate_hz, &capture_buffer, &beamformer);
+ }
+
+ // Extract and verify the test results.
+ std::vector<float> capture_output;
+ test::ExtractVectorFromAudioBuffer(capture_config, &capture_buffer,
+ &capture_output);
+
+ const float kTolerance = 1.0f / 32768.0f;
aluebs-webrtc 2016/03/18 22:51:51 The 0s after the dot are not necessary. There is p
peah-webrtc 2016/03/21 08:02:07 Good point! Done.
+
+ // Compare the output with the reference. Only the first values of the output
+ // from last frame processed are compared in order not having to specify all
+ // preceeding frames as testvectors. As the algorithm being tested has a
+ // memory, testing only the last frame implicitly also tests the preceeding
+ // frames.
+ EXPECT_TRUE(test::BitExactFrame(
aluebs-webrtc 2016/03/18 22:51:50 If it receives a tolerance it is not a bit-exact t
peah-webrtc 2016/03/21 08:02:08 Good point! What about VectorDifferenceBounded an
aluebs-webrtc 2016/03/22 12:15:56 I think your suggestion is much more intuitive. Bu
peah-webrtc 2016/03/23 22:06:19 Good, I think that change will be for the better.
aluebs-webrtc 2016/03/24 11:14:25 Acknowledged.
+ capture_config.num_frames(), capture_config.num_channels(),
+ output_reference, capture_output, kTolerance));
+}
+
+std::vector<Point> CreateArrayGeometry(int variant) {
+ std::vector<Point> array_geometry;
+ switch (variant) {
aluebs-webrtc 2016/03/18 22:51:52 Maybe have a variant with more than 2 points?
peah-webrtc 2016/03/21 08:02:08 Done.
+ case 1:
+ array_geometry.push_back(Point(-0.025f, 0.f, 0.f));
+ array_geometry.push_back(Point(0.025f, 0.f, 0.f));
+ break;
+ case 2:
+
aluebs-webrtc 2016/03/18 22:51:52 Remove blank line?
peah-webrtc 2016/03/21 08:02:07 Done.
+ array_geometry.push_back(Point(-0.035f, 0.f, 0.f));
+ array_geometry.push_back(Point(0.035f, 0.f, 0.f));
+
aluebs-webrtc 2016/03/18 22:51:52 Remove blank line?
peah-webrtc 2016/03/21 08:02:08 Done.
+ break;
+ case 3:
+
aluebs-webrtc 2016/03/18 22:51:52 Remove blank line?
peah-webrtc 2016/03/21 08:02:08 Done.
+ array_geometry.push_back(Point(-0.5f, 0.f, 0.f));
+ array_geometry.push_back(Point(0.5f, 0.f, 0.f));
+ break;
+ default:
+ RTC_CHECK(false);
+ }
+ return array_geometry;
+}
+
+const SphericalPointf TargetDirection1(static_cast<float>(M_PI) / 2.f,
+ 0.f,
+ 1.f);
+const SphericalPointf TargetDirection2(static_cast<float>(M_PI) / 2.f,
+ 0.f,
+ 2.f);
aluebs-webrtc 2016/03/18 22:51:51 The radius is completely ignored, but it would be
peah-webrtc 2016/03/21 08:02:06 Absolutely, what about the new one?
aluebs-webrtc 2016/03/22 12:15:56 That is elevation, right? I meant azimuth, the fir
peah-webrtc 2016/03/23 22:06:19 Ah, sorry about that! I will change that.
+
+} // namespace
+
+// TODO(peah): Investigate why the nonlinear_beamformer.cc causes a DCHECK in
aluebs-webrtc 2016/03/18 22:51:52 I think this should be resolved before landing thi
peah-webrtc 2016/03/21 08:02:08 I don't agree and I cannot see why that would be d
aluebs-webrtc 2016/03/22 12:15:55 What I am afraid of, is that this might be an issu
peah-webrtc 2016/03/23 22:06:19 I don't think it is an issue with the test as the
aluebs-webrtc 2016/03/24 11:14:25 Well, it definitively is possible to DCHECK on the
peah-webrtc 2016/03/24 11:51:30 True. Firstly, using the new configurations, I was
aluebs-webrtc 2016/03/28 23:01:17 That is weird, since those DCHECKs only depend on
+// this setup.
+TEST(BeamformerBitExactnessTest,
aluebs-webrtc 2016/03/18 22:51:52 This test would be a lot simpler if we use TEST_P
peah-webrtc 2016/03/21 08:02:08 Very likely, but I could not come up with a good w
aluebs-webrtc 2016/03/22 12:15:55 You can have a function, similar to CreateArrayGeo
peah-webrtc 2016/03/23 22:06:19 Ah, then I see. That is a good suggestion and most
aluebs-webrtc 2016/03/24 11:14:25 I think using TEST_P is exactly as verbose, since
peah-webrtc 2016/03/24 11:51:30 Yes, the initial version of the bitexactness test
aluebs-webrtc 2016/03/28 23:01:17 I don't see any comments of the reviewers before t
peah-webrtc 2016/03/29 05:19:19 The comment is there with the timestamp 2015-12-10
+ DISABLED_Stereo8kHz_ArrayGeometry1_TargetDirection1) {
+ const float kOutputReference[] = {-0.000161f, 0.000171f, -0.000096f,
+ 0.001007f, 0.000427f, 0.000977f};
+
+ std::vector<Point> array_geometry = CreateArrayGeometry(1);
aluebs-webrtc 2016/03/18 22:51:51 Do we need this intermediate variable?
peah-webrtc 2016/03/21 08:02:09 Done.
+
+ RunBitExactnessTest(8000, array_geometry, TargetDirection1, kOutputReference);
aluebs-webrtc 2016/03/18 22:51:51 Use AudioProcessing::kSampleRate8kHz or define you
peah-webrtc 2016/03/21 08:02:08 Done.
+}
+
+TEST(BeamformerBitExactnessTest, Stereo16kHz_ArrayGeometry1_TargetDirection1) {
+ const float kOutputReference[] = {0.001144f, -0.001026f, 0.001074f,
+ -0.016205f, -0.007324f, -0.015656f};
+
+ std::vector<Point> array_geometry = CreateArrayGeometry(1);
aluebs-webrtc 2016/03/18 22:51:52 Do we need this intermediate variable?
peah-webrtc 2016/03/21 08:02:09 Done.
+
+ RunBitExactnessTest(16000, array_geometry, TargetDirection1,
aluebs-webrtc 2016/03/18 22:51:51 Use AudioProcessing::kSampleRate16kHz or define yo
peah-webrtc 2016/03/21 08:02:08 Done.
+ kOutputReference);
+}
+
+TEST(BeamformerBitExactnessTest, Stereo32kHz_ArrayGeometry1_TargetDirection1) {
+ const float kOutputReference[] = {0.000732f, -0.000397f, 0.000610f,
+ -0.005768f, -0.001495f, -0.007111f};
+
+ std::vector<Point> array_geometry = CreateArrayGeometry(1);
aluebs-webrtc 2016/03/18 22:51:52 Do we need this intermediate variable?
peah-webrtc 2016/03/21 08:02:08 Done.
+
+ RunBitExactnessTest(32000, array_geometry, TargetDirection1,
aluebs-webrtc 2016/03/18 22:51:51 Use AudioProcessing::kSampleRate32kHz or define yo
peah-webrtc 2016/03/21 08:02:08 Done.
+ kOutputReference);
+}
+
+TEST(BeamformerBitExactnessTest, Stereo48kHz_ArrayGeometry1_TargetDirection1) {
+ const float kOutputReference[] = {0.000106f, -0.000464f, 0.000188f,
+ -0.007476f, 0.002662f, -0.007240f};
+
+ std::vector<Point> array_geometry = CreateArrayGeometry(1);
aluebs-webrtc 2016/03/18 22:51:51 Do we need this intermediate variable?
peah-webrtc 2016/03/21 08:02:07 Done.
+
+ RunBitExactnessTest(48000, array_geometry, TargetDirection1,
aluebs-webrtc 2016/03/18 22:51:51 Use AudioProcessing::kSampleRate48kHz or define yo
peah-webrtc 2016/03/21 08:02:07 Done.
+ kOutputReference);
+}
+
+TEST(BeamformerBitExactnessTest,
+ DISABLED_Stereo8kHz_ArrayGeometry1_TargetDirection2) {
+ const float kOutputReference[] = {0.001144f, -0.001026f, 0.001074f,
+ -0.016205f, -0.007324f, -0.015656f};
+
+ std::vector<Point> array_geometry = CreateArrayGeometry(1);
aluebs-webrtc 2016/03/18 22:51:52 Do we need this intermediate variable?
peah-webrtc 2016/03/21 08:02:07 Done.
+
+ RunBitExactnessTest(8000, array_geometry, TargetDirection2, kOutputReference);
aluebs-webrtc 2016/03/18 22:51:52 Use AudioProcessing::kSampleRate8kHz or define you
peah-webrtc 2016/03/21 08:02:07 Done.
+}
+
+TEST(BeamformerBitExactnessTest, Stereo16kHz_ArrayGeometry1_TargetDirection2) {
+ const float kOutputReference[] = {0.001144f, -0.001026f, 0.001074f,
+ -0.016205f, -0.007324f, -0.015656f};
+
+ std::vector<Point> array_geometry = CreateArrayGeometry(1);
aluebs-webrtc 2016/03/18 22:51:51 Do we need this intermediate variable?
peah-webrtc 2016/03/21 08:02:08 Done.
+
+ RunBitExactnessTest(16000, array_geometry, TargetDirection2,
aluebs-webrtc 2016/03/18 22:51:52 Use AudioProcessing::kSampleRate16kHz or define yo
peah-webrtc 2016/03/21 08:02:08 Done.
+ kOutputReference);
+}
+
+TEST(BeamformerBitExactnessTest, Stereo32kHz_ArrayGeometry1_TargetDirection2) {
+ const float kOutputReference[] = {0.000732f, -0.000397f, 0.000610f,
+ -0.005768f, -0.001495f, -0.007111f};
+
+ std::vector<Point> array_geometry = CreateArrayGeometry(1);
aluebs-webrtc 2016/03/18 22:51:52 Do we need this intermediate variable?
peah-webrtc 2016/03/21 08:02:07 Done.
+
+ RunBitExactnessTest(32000, array_geometry, TargetDirection2,
aluebs-webrtc 2016/03/18 22:51:51 Use AudioProcessing::kSampleRate32kHz or define yo
peah-webrtc 2016/03/21 08:02:08 Done.
+ kOutputReference);
+}
+
+TEST(BeamformerBitExactnessTest, Stereo48kHz_ArrayGeometry1_TargetDirection2) {
+ const float kOutputReference[] = {0.000106f, -0.000464f, 0.000188f,
+ -0.007476f, 0.002662f, -0.007240f};
+
+ std::vector<Point> array_geometry = CreateArrayGeometry(1);
aluebs-webrtc 2016/03/18 22:51:52 Do we need this intermediate variable?
peah-webrtc 2016/03/21 08:02:09 Done.
+
+ RunBitExactnessTest(48000, array_geometry, TargetDirection2,
aluebs-webrtc 2016/03/18 22:51:50 Use AudioProcessing::kSampleRate48kHz or define yo
peah-webrtc 2016/03/21 08:02:08 Done.
+ kOutputReference);
+}
+
+TEST(BeamformerBitExactnessTest, Stereo8kHz_ArrayGeometry2_TargetDirection2) {
+ const float kOutputReference[] = {-0.000649f, 0.000576f, -0.000148f,
+ -0.015625f, -0.006866f, -0.014374f};
+
+ std::vector<Point> array_geometry = CreateArrayGeometry(2);
aluebs-webrtc 2016/03/18 22:51:51 Do we need this intermediate variable?
peah-webrtc 2016/03/21 08:02:08 Done.
+
+ RunBitExactnessTest(8000, array_geometry, TargetDirection2, kOutputReference);
aluebs-webrtc 2016/03/18 22:51:51 Use AudioProcessing::kSampleRate8kHz or define you
peah-webrtc 2016/03/21 08:02:07 Done.
+}
+
+TEST(BeamformerBitExactnessTest, Stereo16kHz_ArrayGeometry2_TargetDirection2) {
+ const float kOutputReference[] = {0.000808f, -0.000695f, 0.000739f,
+ -0.016205f, -0.007324f, -0.015656f};
+
+ std::vector<Point> array_geometry = CreateArrayGeometry(2);
aluebs-webrtc 2016/03/18 22:51:50 Do we need this intermediate variable?
peah-webrtc 2016/03/21 08:02:08 Done.
+
+ RunBitExactnessTest(16000, array_geometry, TargetDirection2,
aluebs-webrtc 2016/03/18 22:51:52 Use AudioProcessing::kSampleRate16kHz or define yo
peah-webrtc 2016/03/21 08:02:09 Done.
+ kOutputReference);
+}
+
+TEST(BeamformerBitExactnessTest, Stereo32kHz_ArrayGeometry2_TargetDirection2) {
+ const float kOutputReference[] = {0.000580f, -0.000183f, 0.000458f,
+ -0.005768f, -0.001495f, -0.007111f};
+
+ std::vector<Point> array_geometry = CreateArrayGeometry(2);
aluebs-webrtc 2016/03/18 22:51:52 Do we need this intermediate variable?
peah-webrtc 2016/03/21 08:02:07 Done.
+
+ RunBitExactnessTest(32000, array_geometry, TargetDirection2,
aluebs-webrtc 2016/03/18 22:51:52 Use AudioProcessing::kSampleRate32kHz or define yo
peah-webrtc 2016/03/21 08:02:07 Done.
+ kOutputReference);
+}
+
+TEST(BeamformerBitExactnessTest, Stereo48kHz_ArrayGeometry2_TargetDirection2) {
+ const float kOutputReference[] = {0.000075f, -0.000288f, 0.000156f,
+ -0.007476f, 0.002662f, -0.007240f};
+
+ std::vector<Point> array_geometry = CreateArrayGeometry(2);
aluebs-webrtc 2016/03/18 22:51:52 Do we need this intermediate variable?
peah-webrtc 2016/03/21 08:02:07 Done.
+
+ RunBitExactnessTest(48000, array_geometry, TargetDirection2,
aluebs-webrtc 2016/03/18 22:51:51 Use AudioProcessing::kSampleRate48kHz or define yo
peah-webrtc 2016/03/21 08:02:06 Done.
+ kOutputReference);
+}
+
+// TODO(peah): Investigate why the nonlinear_beamformer.cc causes a DCHECK in
aluebs-webrtc 2016/03/18 22:51:51 I think this should be resolved before landing thi
peah-webrtc 2016/03/21 08:02:08 As for the corresponding above comment, I don't ag
+// this setup.
+TEST(BeamformerBitExactnessTest,
+ DISABLED_Stereo16kHz_ArrayGeometry3_TargetDirection1) {
+ const float kOutputReference[] = {-0.000161f, 0.000171f, -0.000096f,
+ 0.001007f, 0.000427f, 0.000977f};
+
+ std::vector<Point> array_geometry = CreateArrayGeometry(3);
aluebs-webrtc 2016/03/18 22:51:51 Do we need this intermediate variable?
peah-webrtc 2016/03/21 08:02:07 Done.
+
+ RunBitExactnessTest(16000, array_geometry, TargetDirection1,
+ kOutputReference);
+}
+
+} // namespace webrtc
« no previous file with comments | « no previous file | webrtc/modules/modules.gyp » ('j') | webrtc/modules/modules.gyp » ('J')

Powered by Google App Engine
This is Rietveld 408576698