a dd10@sRddlmZddlZddlZddlmZddlZddlm Z m Z m Z ddl m Z ddlZejdddlZdZdd d d d d d d d d dd dd dd dd dd dd dd dd dd eejddddejdddddedeejedejdddddedeejedejdd dddejd d! d"d ee dd#e dddd$d%e ed&d'd(e dejddd)ddedeejedejddd)ddedeejedejdd d)ddejd d!d*d d+d ee dd#e dddd$d%e ed&d'd(edd,d)dded,ejd'd-ed,d,d)dded,ejd'd-ed,d,d)dded,ejd'd-ed,d,d)dded,ejd'd-ed,d d)ddejd d!eeddd#dd$ejddd)ddedeejedejddd)ddedeejedejdd d)ddejd d! eeddddd$ejddd d.edeejdd d d.eejd d!eeddd#dd$ejddd/d0dedeejddd)ddedeejdd d0d dejd d! eeddd#dd$ejddd)ddedeejddd)ddedeejdd d)ddejd d! eejddd/ddedeejddd/ddedeejdd d/ddejd d!eejddd)d.edeejdd d)d.eejd d!eejdd#d d.ed#eejd#d d d.eejd d!eejddd d.edeejdd d d.eejd d!eejd1d2d d.ed2eejd2d d d.eejd d!eejd1dd d.edeejedejdd2d d.ed2eejedejd2d2d d.ed2eejedejd2d d d.ejd d!d3ZdS)4)nnN)BinarizeConv1d)STFT MelFilterLog1p) PCENLayerz"/nfs/NAS5/best/cacha_detec/sincnet?cCstS)N)r Sequentialnfeatkernelr (/nfs/NAS6/mahe/ceta-cnns/Train/models.pyrcCsttddtdddddttddd tdtj d||d d t|t t t tj |||d d t|t t t tj |d |d d tj d d S)N@acATa trainablestride output_sizerr rrrnplog10 BatchNorm1dudepthwise_separable_conv1d LeakyReLU Dropout1dpDropoutAdaptiveMaxPool1dr r r rrs cCsttddtjd|ddddt|dtttj|d|dddt|tttj||dddt|tttj||dddt|tttj|ddddtjdd S) Nrrr r) rr r%ReshapeConv1dr$r(r)r*r r r rr#s    cCsttddtdddddttddd tjd||d dd tj t d tj|||d dd tj t d tj|d |d dd tj d d S)NrrPrrrrTrr)rquatprr) rr rrrr"r#r%Quat_depthwise_separable_conv1dDropoutr)r*)fkr r rr4s   cCs|ttddtdddddttddd tjd|d d d tj t d tj||d d d tj t d tj|dd d d tj dd SNrri}rri>rTrr.rrr5rr rr rrrr"r#r%r&r8r)r*r2r r rr?s   cCs|ttddtdddddttddd tjd|d d d tj t d tj||d d d tj t d tj|dd d d tj dd Sr;r<r2r r rrJs   cCsttddtdddddttddd tjd||d d t |t t t tj|||d d t |t t t tj|d |d d tj d d  S)Nrrr3rirrTrrrrrrr rrrr"r#r%r&r$r'r(r)r*r r r rrUs cCsttddtdddddttddd tjd||d d t |t t t tj|||d d t |t t t tj|d |d d tj d d  SNrrr3rrrrTrrrrrr=r r r rres cCsttddtdddddttddd tjd||d d t |t t t tj|||d d t |t t t tj|d |d d tj d d  S)NrrirrrrTrrrrrr=r r r rrus cCsttddtdddddttddd tdtj d||d d t|t t t tj |||d d t|t t t tj |d |d d tj d d Sr>r!r r r rrs cCsttddtdddddttddd ttj d||d d t |t t t tj |||d d t |t t t tj |d |d d tjd d Sr>)rr rrrr"r#r%SpecNormr&r$r'r(r)r*r r r rrs cCsttddtdddddttddd tjd|d d d t |tj t d tj||d d d t |tj t d tj|dd d d tj dd S)Nrrr3rrrrTrr.rrr5rr) rr rrrr"r#r%r&r$r8r)r*r2r r rrs   cCsnttddtdddddttddd tjd|d d dd tj||d d dd tj|d d d dd tj d dS)Nrrr3rrrrTrr.r)rBNrr) rr rrrr"r#r%r7r*r2r r rrs cCs|ttjddddtjd||ddt|ttt tj|||ddt|ttt tj|d|ddtj dd S) Nrrr3 sample_raterrrr) rr sincnet SincConv_fastr%r&r$r'r(r)r*r r r rrs rrr3rAr-r kernel_sizerr5rrcCszttddtjd|dddt|ttjtdtj||dddt|ttjtdtj|ddddtjdd  S) Nrrir.rrFr5rr) rr rr1r$ReLUr8r)r*r2r r rrs   rrrrTrr.cCsttddtdddddttddd tjd|d d d t|t tj t d tj||d d d t|t tj t d tj|dd d d tj dd S)Nrrr3rrrrTrr.rrFr5rr) rr rrrr"r#r1r$rHr8r)r*r2r r rrs   cCsttddtdddddttddd tjjj j j d|d d d t t tj d ddtjjj j j ||d d d t t tj d ddtjjj j j |dd d d tjdd S)Nrrr3rrrrTrr.rrFrF)r6inplacerr)rr rrrr"r# intrinsic quantizedmodules conv_relu ConvReLU1dIdentityr8r*r2r r rrs   i)rI)rGr, i)Zcwt_depthwise_64kHzZ!stft_depthwise_64kHz_ksize_specBNrawZquat_stft_depthwiseZstft_depthwise_32kHz_bighopZstft_depthwise_32kHzZstft_depthwise_ksize_FBZstft_depthwise_ksizestft_depthwise_ksize_CARIMAMZstft_depthwise_ksize_specBNZstft_depthwise_ksize_specNormZstft_depthwiseZstft_depthwise_noBN_noDOZ sincnet_dwrCZ stft_nomelZ stft_pcenstftZqat_stftZ bool_stftz0.10z0.9z0.8z0.7z0.6z0.5z0.4z0.3z0.2z0.0)torchrutilsr%Zbinarized_modulesrnumpyr"Z filterbankrrrZ PCEN_pytorchrsyspathappendrCr)r rDr1r$r'r8r*r#Hardtanh GammaSpecgetr r r rsh