Questions tagged [normalization]

Use [tag:database-normalization] for normalizing database-structure, and [tag:unicode-normalization] for normalizing unicode text. Normalization refers to transformations which aim to reduce variation of various types of data and thereby allow more consistent processing, searching, sorting, comparison, etc.

0
votes
0answers
12 views

tf.nn.batch_normalization unexpected behavior

I encountered a problem trying to implement tf.nn.batch_normalization working on the mnist digits dataset. tf.VERSION : 1.13.0-rc2 OS : MacOS Mojave 10.14.4 on MacBook Pro (13-inch, 2017) For ...
3
votes
2answers
22 views

Customized normalize by group in R

I have a dataframe that looks like this: group1<-c(rep(1,12)) group2<-c(rep('Low',6), rep('High',6)) var <-c(1:6,1:6) var1 <-c(2:13) var2 <-c(20:31) df1<-data.frame(group1,...
1
vote
1answer
36 views

Python: json normalize “String indices must be integers” error

I am getting a type error as "TypeError: string indices must be integers" in the following code. import pandas as pd import json from pandas.io.json import json_normalize full_json_df = pd....
0
votes
1answer
18 views

unable to import normalize_corpus python 3

I am working on some NLP task, trying to import normalize_corpus from the normalization module. I am getting the below error. from normalization import normalize_corpus ------------------------...
0
votes
0answers
28 views

Flat REST API (No nested relationship)

Off-topic / Duplicate Many asynchronous calls vs single call to the API Many small requests vs. few large requests (API Design) REST API Design: Multiple calls vs. single call to the API ORIGINAL ...
0
votes
1answer
11 views

Symfony 4.2 Custom Circular Reference Handler Does not Apply

The context is that I have been trying to set up a Custom Circular Reference Handler for my entities that will effect ALL entities. According to documentation ( https://symfony.com/doc/current/...
-1
votes
0answers
22 views

Trying to normalize EMR database

I am working on a homework assignment which requires us to normalize our database tables if it is possible. We are creating a basic EMR (electronic medical record) and focusing on the patient/...
1
vote
3answers
45 views

In UML, does composition imply an association class?

In a UML diagram where one class is comprised by another class, is there an implicit association table, or does it need to be shown? For example, if I have Chapters that are composition of Paragraphs,...
-1
votes
0answers
49 views

Choosing method for Normalization

As a part of the homework, I have data-set that has no descriptions or inferences about attributes of the data (no field knowledge). I am asked to analyze and apply a "normalization method" that suits ...
-1
votes
0answers
10 views

I want to know if there're any package who can help me to understand what type of normalization i must do(sqrt, log+1, etc..) for each column

I have got 12 columns with different types of units like: furcal lenght, weight and differents concentrations of heavy metals. I want to know if there are any package who can help me to understand ...
1
vote
1answer
77 views

How to normalize pixel values of an UIImage in Swift?

We are attempting to normalize an UIImage so that it can be passed correctly into a CoreML model. The way we are retrieving the RGB values from each pixel is by first initializing a [CGFloat] array ...
1
vote
0answers
16 views

how to normalize this nested json with pandas

I have this kind of json to be normalized. I use this with pandas: >>> df = json_normalize(data=resp.json()['issues'],meta=['key', ['fields', 'summary']], errors='ignore') >>> df['...
0
votes
0answers
12 views

Normalization in PCAmix

I've planned to do a principal component analysis on both numerical and categorical variables with PCAmix (for example, I want to include brain network measures, which are numerical, but also gender ...
1
vote
1answer
31 views

Is there a way on ojAlgo to normalize a Matrix?

I am interested to know if there is a way to find a normalized form for a MatrixStore using the ojAlgo matrix library. Perhaps a routine or a task that once performed on a MatrixStore will cause ...
0
votes
0answers
23 views

How can I normalize a histogram by a user defined number in matplotlib?

I am not able to figure out how exactly to scale a histogram using matplotlib that I can do in ROOT. I do not want to area normalize to 1. I want to scale a histogram by a given value that I have ...
0
votes
2answers
33 views

How to normalize a multiple input neural network?

I do have a question in regards on how to normalize and especially on how to denormalize neural networks with multiple inputs and only one output. Do I need to normalize the Input variables ...
0
votes
0answers
16 views

Liblognorm json parser rule

Currently i am writing json log normalizer for rsyslog log messages. Actually, it is more complicated but I will make the list short. I am using liblognorm json normalizer rule and I have a problem ...
0
votes
0answers
21 views

How to scale time-series data in time domain (x-axis)?

I have built a Python program to download stock data. Now the stock data looks like this: Date High Low Open Close Volume Adj Close 13/12/2018 0.156 0.150006 0.150006 ...
1
vote
1answer
35 views

Is there a well-defined difference between “normalizing” and “canonicalizing” data?

I understand canonicalization and normalization to mean removing any non-meaningful or ambiguous parts of of a data's presentation, turning effectively identical data into actually identical data. ...
1
vote
1answer
43 views

Analysis of loss curve : raw data VS normalized data (Machine learning / Keras) [closed]

I'm trying to configure my CNN, and this need to analyze loss function results. I'm working with à VGG-16 (CNN). Input data are grey scaled images. So each pixel have a value of [0:255]. For the ...
0
votes
2answers
28 views

How can I split my normalization in two according to column values?

HI I have a column data in pandas with a hugely skewed distribution: I split the data in two according to a cutoff value of 1000 and this is the distribution of the two groups. Now, I want to ...
1
vote
1answer
31 views

jmespath : getting keys with property filter

I have the following json : { "dataset_1": { "size_in_mb": 0.5, "task": "clean", "tags": ["apple", "banana", "strawberry"] }, "dataset_2": { "size_in_mb": ...
0
votes
0answers
13 views

SPM12 'Normalise: Estimate & Write' error

I'm using SPM12 to normalize some nifti (.nii) files. But there is an error after 45% running: Running 'Normalise: Estimate & Write' SPM12: spm_preproc_run (v6365) 14:41:21 - ...
1
vote
1answer
25 views

How to pre-process/normalize IP Address dataset to give as input to K-Means clustering algorithm?

Suppose, I have been given a dataset consisting of: Source IP Address (e.g: 10.200.32.150) Source Port Address (e.g: 443) Destination IP Address (e.g: 10.220.32.210) Destination Port Address (e.g: 80)...
-1
votes
2answers
28 views

Composite key mySQL constraint

If I wanted to write mySQL for this database that's been already normalized, how would I add a constraint for the (Branch_ID, Employee_ID) composite key? Branch Table Branch ID Branch Name Address ...
0
votes
0answers
8 views

How to prevent Encog recognising numerical fields as classes

I have a CSV file with many kinds of values, some of them are numerical whole numbers such as 20, 30, 35, 40 etc. we will call this column A. While others are numerical doubles such as 9.2, 7.1, 6, 9....
-1
votes
1answer
71 views

How Normalize Data Mining Min Max from Mysql in Python

This is example of my data in mysql, I use lib flashext.mysql and python 3 RT NK NB SU SK P TNI IK IB TARGET 84876 902 1192 2098 3623 169 39 133 1063 94095 79194 ...
0
votes
0answers
16 views

Is it necessary to normalize/standardize binary predictors when applying support vector machines?

I'm new to machine learning. I understand that continuous variables/predictors need to be standardized/normalized before applying a support vector machine (SVM) method. What do we do with categorical ...
0
votes
3answers
48 views

How Normalize Data Mining in Python with library

How Normalize Data Mining MinMax from csv in Python 3 with library this is example of my data RT NK NB SU SK P TNI IK IB TARGET 84876 902 1192 2098 3623 169 39 133 ...
1
vote
1answer
40 views

How to normalize data series to start value = 0?

I have a dataset similar to this: library(ggplot2) data(economics_long) economics_long$date2 <- as.numeric(economics_long$date) + 915 ggplot(economics_long, aes(date2, value01, colour = variable)) ...
0
votes
0answers
22 views

Normalizing nested responses in ngrx

I am fairly new to ngrx and I am not sure what the best practices are regarding normalizing nested objects. Let say the store is defined as follow: export interface User { id: string; name: ...
1
vote
1answer
28 views

How to use MaxAbsScaler to standardize values ​between 1 and 100

Given that I have data in a data frame as follows: import pandas as pd value_1 = [1, 2, 3, 4, 5] value_2 = [1000, 20000, 50000, 33000, 21000] value_3 = [0, 1, 0, 1, 1] value_4 = [4, 8, 12, 10, 19] ...
0
votes
0answers
26 views

Trying to change data type for column but getting ERROR 1265: Data Truncated

I have a column filled with integers as type VARCHAR(2). I'm trying to run the following command in a mySQL server to change the column currently varchar(2) to an integer: ALTER TABLE myTable MODIFY ...
0
votes
1answer
18 views

Is it possible to create an 'average' volume from an mp3 file using JavaScript?

I have been unable to find any kind of library that is capable of creating an average volume of an mp3 file that supports JavaScript on a web client, not in NodeJS. I need it on a web client as it is ...
0
votes
0answers
26 views

Matplotlib Image Pixel Intensity Normalization

I've been playing around with the Richardson-Lucy deconvolution function available in the skimage package. There was a sample code that enabled me to noise and de-noise the image. I would like to ...
0
votes
1answer
43 views

While normalizing the data in python, getting this error:Error evaluating factor: TypeError: list indices must be integers or slices, not str

My data: absent_data.head() My data Before it was running smooth, this is my code: cnames = ['Transportation expense', 'Distance from Residence to Work', 'Service time', 'Age', 'Work load ...
2
votes
1answer
38 views

How can I fit the test data using min max scaler when I am loading the model?

I am doing auto encoder model.I have saved the model before which I scaled the data using min max scaler. X_train = df.values scaler = MinMaxScaler() X_train_scaled = scaler.fit_transform(X_train) ...
0
votes
0answers
12 views

How to denormalize regression output?

For a simple regression model, y = c + p*x. I have normalized x using z_score method and trained the regression model using tensor flow computational graph. Now the output of the regression model ...
0
votes
1answer
31 views

Normalization by min-max & stand deviation method to only certain columns using Python or R

I have a dataframe which has 37 variables and 50,000 rows. There are both categorical and numerical features. I would like to do the normalization function to some columns in the dataframe. Here is ...
0
votes
0answers
19 views

Normalizing power law data input to multilayer perceptron

I have simulated power law data as: bins = np.arrange(0.1,10.0,0.1) And then calculate y using the formula y = c*x^p where c and p are arbitrary constants. (in my case 2.0) y = c*x^p #generate ...
0
votes
0answers
7 views

Applying transformations to achieve normal distribution for a new variable

I am running a two-way ANOVA using scores on four symptom types (physical, cognitive, sleep and emotional symptoms) as a dependent variable and sex and symptom type as independent variables. I'm ...
0
votes
0answers
20 views

Applying transformations to meet normality to pretest posttest design

I am conducting a pretest posttest analysis using IQ data. The pretest occurred before a traumatic brain injury and the posttest occurred after. The hypothesis is that those with higher pre-injury IQs ...
0
votes
0answers
40 views

how to normalize python list with different length to a given length?

I have a python series. The series contains lists with different lengths. 0 [2, 0, 2, 0, 2, 1, 0, 0, 0, 1, 1, 2, 2, 0, 2, ... 1 [2, 2] 2 ...
2
votes
1answer
35 views

How would you “Normalize” this SQL? [closed]

So, I will have a table called "REPS". In that table I will have this info. ID NAME ZIP_CODES I need to figure out how I should do the ZIP_CODES section. Should it be JSON format of zip codes? ...
0
votes
0answers
21 views

What is the better way of getting concatenated rows from a child table in a query?

For my college project I am doing a model e-commerce website for learning. I have searched for similar questions, however I am unable to get deeper ideas. My current tables structure: Products - sku(...
-1
votes
1answer
27 views

Normalise positively skewed data with heavy tailed distribution

I am trying to figure out how to normalised some positively skewed data. data I really need it to have some parvence of positive distribution, but I have already tried log-transforming and it simply ...
-2
votes
2answers
52 views

Weighted features in machine learning

I am a beginner in machine learning. So any help or suggestion would be of great help. I have read that putting weights on features and Predicting is a very bad idea. But what if few features needs ...
2
votes
2answers
36 views

Normalizing a two complement number

I am working on some Tensilica processor and I don't understand the normalization process. NSA - Normalized Shift Amount NSA at, as NSA calculates the left shift amount that will normalize the ...
1
vote
1answer
35 views

Javascript - convert a text with accents, spaces and capitals to one without accents with hyphens and lowercase

I want convert to text with accents, spaces and capitals to one without accents with hyphens and lowercase. my solution is: var text ='Canción del Amor'; const nt = text.replace(/\s+/g, '-')....
2
votes
1answer
75 views

Flatten DataFrame nested list/array with extra index keys (for time series)

I have a DataFrame structured as follows. (It is a result of JSON normalization) mydf id colA colB ... colArray foo a1 b1 [{'date': '...', 'data1': '...', 'data2': 0.1 ...

http://mssss.yulina-kosm.ru